Max level shown:
1 [ Nov 13 20:40:11 Enabled. ]
2 [ Nov 13 20:40:11 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 13 20:40:11 Method "start" exited with status 0. ]
4 [ Nov 13 20:40:11 Rereading configuration. ]
5 [ Nov 13 20:40:11 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-13T20:40:11.452ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-13T20:40:11.452ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-13T20:40:11.505ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-13T20:40:11.505ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-13T20:40:11.620ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-13T20:40:11.629ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-13T20:40:11.637ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-13T20:40:12.238ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-13T20:40:12.374ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-13T20:40:12.374ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-13T20:40:12.375ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-13T20:40:12.375ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-13T20:40:12.375ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-11-13T20:40:12.375ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-11-13T20:40:12.378ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-13T20:40:12.378ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-13T20:40:12.378ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-13T20:40:12.378ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-13T20:40:12.378ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-13T20:40:12.378ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-13T20:40:12.378ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-13T20:40:12.378ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-13T20:40:12.378ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-13T20:40:12.390ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-13T20:40:12.390ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool)
322024-11-13T20:40:12.490ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal }
332024-11-13T20:40:12.967ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-13T20:40:12.968ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-13T20:40:12.968ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-13T20:40:12.968ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-13T20:40:12.968ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-13T20:40:12.968ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-13T20:40:12.968ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-13T20:40:12.976ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-13T20:40:12.976ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool)
422024-11-13T20:40:13.064ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal }
432024-11-13T20:40:13.523ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-13T20:40:13.523ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-13T20:40:13.523ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-13T20:40:13.523ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-13T20:40:13.523ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-13T20:40:13.523ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-13T20:40:13.523ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
522024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-11-13T20:40:13.523ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-13T20:40:13.523ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-13T20:40:13.523ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-13T20:40:13.523ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-11-13T20:40:13.523ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-11-13T20:40:13.523ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-13T20:40:13.523ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
632024-11-13T20:40:13.523ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642024-11-13T20:40:13.523ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-13T20:40:13.523ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-13T20:40:13.523ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-13T20:40:13.523ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-13T20:40:13.523ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-13T20:40:13.523ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-13T20:40:13.523ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-13T20:40:13.523ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-13T20:40:13.523ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-13T20:40:13.523ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-13T20:40:13.523ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-11-13T20:40:13.523ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-11-13T20:40:13.523ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
842024-11-13T20:40:13.523ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-13T20:40:13.523ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-13T20:40:13.523ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-13T20:40:13.523ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-13T20:40:13.524ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-13T20:40:13.524ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-11-13T20:40:13.524ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-13T20:40:13.524ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-13T20:40:13.524ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-11-13T20:40:13.524ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-13T20:40:13.524ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-13T20:40:13.524ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-13T20:40:13.524ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-13T20:40:13.524ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-13T20:40:13.524ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-13T20:40:13.524ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-13T20:40:13.524ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-13T20:40:13.524ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-13T20:40:13.524ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-13T20:40:13.524ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-13T20:40:13.524ZINFOSledAgent (bootstore): No ledger in /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-11-13T20:40:13.524ZINFOSledAgent (bootstore): No ledger in /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-11-13T20:40:13.524ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-11-13T20:40:13.524ZINFOSledAgent (bootstore): No ledger in /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-11-13T20:40:13.524ZINFOSledAgent (bootstore): No ledger in /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-11-13T20:40:13.524ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-11-13T20:40:13.524ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-13T20:40:13.524ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-13T20:40:13.535ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-13T20:40:13.535ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1376, tv_nsec: 379264900 } time_to_next_cleanup = 599.999929429s
1142024-11-13T20:40:13.535ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-11-13T20:40:13.535ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-13T20:40:13.535ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-13T20:40:13.538ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-13T20:40:13.538ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-11-13T20:40:13.540ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-11-13T20:40:13.540ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1198
1212024-11-13T20:40:13.540ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-13T20:40:13.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-13T20:40:13.540ZINFOSledAgent (RSS): No ledger in /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-13T20:40:13.540ZINFOSledAgent (RSS): No ledger in /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-13T20:40:13.540ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1261
1262024-11-13T20:40:13.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-13T20:40:13.540ZINFOSledAgent (RSS): No ledger in /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-13T20:40:13.540ZINFOSledAgent (RSS): No ledger in /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-13T20:40:13.540ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1303
1302024-11-13T20:40:13.540ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-13T20:40:13.540ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-13T20:40:13.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-13T20:40:13.540ZINFOSledAgent (RSS): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-13T20:40:13.541ZINFOSledAgent (RSS): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-13T20:40:13.541ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: 849aa495-6145-49b0-a290-3c6c58cf8497, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: b6e177bd-5357-4f01-b047-206109321c43 (sled), rack_id: 849aa495-6145-49b0-a290-3c6c58cf8497, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-13T20:40:13.541ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1337
1372024-11-13T20:40:13.541ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-11-13T20:40:13.541ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-11-13T20:40:13.541ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-11-13T20:40:13.541ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-11-13T20:40:13.541ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: b6e177bd-5357-4f01-b047-206109321c43 (sled), rack_id: 849aa495-6145-49b0-a290-3c6c58cf8497, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-11-13T20:40:13.542ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1432024-11-13T20:40:13.542ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1442024-11-13T20:40:13.546ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-13T20:40:13.551ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-13T20:40:13.551ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-13T20:40:13.555ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-13T20:40:13.556ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-13T20:40:13.556ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:42605
1502024-11-13T20:40:13.556ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: b6e177bd-5357-4f01-b047-206109321c43 (sled), rack_id: 849aa495-6145-49b0-a290-3c6c58cf8497, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-13T20:40:13.556ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-13T20:40:13.556ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-13T20:40:13.556ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-13T20:40:13.556ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-11-13T20:40:13.556ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-11-13T20:40:13.556ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1572024-11-13T20:40:13.556ZINFOSledAgent (StorageManager): No ledger in /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-13T20:40:13.556ZINFOSledAgent (StorageManager): No ledger in /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-13T20:40:13.556ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-11-13T20:40:13.556ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-11-13T20:40:13.556ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-11-13T20:40:13.556ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-13T20:40:13.556ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-13T20:40:13.572ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-13T20:40:13.592ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-13T20:40:13.610ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-13T20:40:13.619ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = b6e177bd-5357-4f01-b047-206109321c43
1682024-11-13T20:40:13.619ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-13T20:40:13.619ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = b6e177bd-5357-4f01-b047-206109321c43
1702024-11-13T20:40:13.619ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-13T20:40:13.622ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 115.170309ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "006e5900-c754-4fbb-89a3-dc8e935d0e8a", "content-length": "124", "date": "Wed, 13 Nov 2024 20:40:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "006e5900-c754-4fbb-89a3-dc8e935d0e8a" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-13T20:40:13.632ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_b7cb2d93-67d8-40f4-ba66-b9d64de62594/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-13T20:40:13.655ZINFOSledAgent: successfully created encrypted zvol: name="oxi_b7cb2d93-67d8-40f4-ba66-b9d64de62594/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-13T20:40:13.655ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_b7cb2d93-67d8-40f4-ba66-b9d64de62594/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-13T20:40:13.662ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = b6e177bd-5357-4f01-b047-206109321c43
1762024-11-13T20:40:13.662ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-13T20:40:13.662ZINFOSledAgent (BackingFs): Ensuring dataset oxi_b7cb2d93-67d8-40f4-ba66-b9d64de62594/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-13T20:40:13.738ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-13T20:40:13.739ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 90.051163ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "68e0de39-4526-425b-8752-4e2f132fa3f3", "content-length": "124", "date": "Wed, 13 Nov 2024 20:40:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "68e0de39-4526-425b-8752-4e2f132fa3f3" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-13T20:40:13.753ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-13T20:40:13.830ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-13T20:40:13.830ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 212.820226ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8766c8c6-b225-4953-9d6f-c0f087c38387", "content-length": "124", "date": "Wed, 13 Nov 2024 20:40:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8766c8c6-b225-4953-9d6f-c0f087c38387" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-13T20:40:13.974ZINFOSledAgent (BackingFs): Mounting oxi_b7cb2d93-67d8-40f4-ba66-b9d64de62594/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-11-13T20:40:13.986ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-11-13T20:40:13.986ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-11-13T20:40:13.986ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-11-13T20:40:13.986ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-11-13T20:40:14.044ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-13T20:40:14.045ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 177.422222ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "80774994-a186-430a-9463-88b96c3a84e7", "content-length": "124", "date": "Wed, 13 Nov 2024 20:40:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "80774994-a186-430a-9463-88b96c3a84e7" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-13T20:40:14.223ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-13T20:40:14.224ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 108.589879ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "37ab88ac-6c2a-41fa-b02a-66f5c013a515", "content-length": "124", "date": "Wed, 13 Nov 2024 20:40:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "37ab88ac-6c2a-41fa-b02a-66f5c013a515" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-13T20:40:14.334ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-13T20:40:14.335ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 292.858316ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fc8eb0c8-0d47-421d-9aa1-703aeddab1be", "content-length": "124", "date": "Wed, 13 Nov 2024 20:40:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fc8eb0c8-0d47-421d-9aa1-703aeddab1be" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-13T20:40:14.628ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-13T20:40:14.629ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 349.40849ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6fdb2359-2bbb-4fc4-86cd-efa1f88b5e85", "content-length": "124", "date": "Wed, 13 Nov 2024 20:40:14 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6fdb2359-2bbb-4fc4-86cd-efa1f88b5e85" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-13T20:40:14.718ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = b6e177bd-5357-4f01-b047-206109321c43
1972024-11-13T20:40:14.723ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:53447 sled_id = b6e177bd-5357-4f01-b047-206109321c43
1982024-11-13T20:40:14.724ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = b6e177bd-5357-4f01-b047-206109321c43
1992024-11-13T20:40:14.724ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:53447 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = b6e177bd-5357-4f01-b047-206109321c43 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2002024-11-13T20:40:14.725ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 252.404953ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2012024-11-13T20:40:14.726ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2022024-11-13T20:40:14.726ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2032024-11-13T20:40:14.726ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2042024-11-13T20:40:14.726ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-11-13T20:40:14.979ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062024-11-13T20:40:14.979ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 674.738589ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2072024-11-13T20:40:15.657ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 785.230172ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2082024-11-13T20:40:16.444ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.417915783s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2092024-11-13T20:40:17.215ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2102024-11-13T20:40:17.215ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2112024-11-13T20:40:17.215ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2122024-11-13T20:40:17.215ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2132024-11-13T20:40:17.215ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2142024-11-13T20:40:17.215ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2152024-11-13T20:40:17.217ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2162024-11-13T20:40:17.218ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2172024-11-13T20:40:17.219ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='485b8115-17f1-4d4c-b08e-d77bebf52411'/> <propval type="astring" name="rack_id" value='849aa495-6145-49b0-a290-3c6c58cf8497'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:febf:f441'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='849aa495-6145-49b0-a290-3c6c58cf8497'/> <propval type="astring" name="sled_id" value='b6e177bd-5357-4f01-b047-206109321c43'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='b6e177bd-5357-4f01-b047-206109321c43'/> <propval type="astring" name="rack_uuid" value='849aa495-6145-49b0-a290-3c6c58cf8497'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='b6e177bd-5357-4f01-b047-206109321c43'/> <propval type="astring" name="rack_uuid" value='849aa495-6145-49b0-a290-3c6c58cf8497'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-13T20:40:17.219ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-13T20:40:17.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 31.298633ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-13T20:40:17.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 50.762352ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-13T20:40:17.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 261.213ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-13T20:40:17.880ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.291380739s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2232024-11-13T20:40:18.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 593.1755ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-13T20:40:19.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 737.178656ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-13T20:40:19.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 931.270127ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-13T20:40:21.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 896.915866ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-13T20:40:21.172ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.018587025s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2282024-11-13T20:40:21.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.008261388s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-13T20:40:23.385ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/nexus.rs:527 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2302024-11-13T20:40:23.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2312024-11-13T20:40:23.416ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2322024-11-13T20:40:23.417ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12345
2332024-11-13T20:40:23.417ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2342024-11-13T20:40:23.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2352024-11-13T20:40:23.417ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-13T20:40:23.417ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-13T20:40:23.417ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2382024-11-13T20:40:23.417ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2392024-11-13T20:40:23.417ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2402024-11-13T20:40:23.417ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:42605
2412024-11-13T20:40:23.638ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2422024-11-13T20:40:23.638ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2432024-11-13T20:40:23.638ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2442024-11-13T20:40:23.638ZINFOSledAgent (RSS): No ledger in /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-13T20:40:23.638ZINFOSledAgent (RSS): No ledger in /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-13T20:40:23.638ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-13T20:40:23.639ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-13T20:40:23.639ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-11-13T20:40:23.639ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-13T20:40:23.643ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2512024-11-13T20:40:23.643ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2522024-11-13T20:40:23.643ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2532024-11-13T20:40:23.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51370
2542024-11-13T20:40:23.964ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2552024-11-13T20:40:23.964ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-13T20:40:23.964ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-11-13T20:40:23.964ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-13T20:40:23.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51370 req_id = 8cc75275-1ee6-4612-b12a-eb3a465cf9c2 response_code = 200 uri = /inventory
2592024-11-13T20:40:23.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43017
2602024-11-13T20:40:23.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43017 req_id = c6d81d6f-86ec-4b11-b869-fd53975f7d87 response_code = 200 uri = /sled-role
2612024-11-13T20:40:23.997ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2622024-11-13T20:40:23.997ZINFOSledAgent (RSS): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-11-13T20:40:23.998ZINFOSledAgent (RSS): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-13T20:40:23.998ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2652024-11-13T20:40:24.036ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: cad2b043-bf0f-4313-9a95-7117f0215aa3, pool_id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: aac79af1-9ba1-447c-af0b-f69098c37c58, pool_id: e43f0729-982f-4960-b10a-7966152ae48a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: f600988e-6b9d-4852-ab52-5da00c12c56e, pool_id: 94d47f77-b938-4683-89de-401156b9868f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 531ad966-4c71-4b15-b8f8-bedd182ade03, pool_id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 425238f0-d5fc-44bd-85fb-cf397621ab0e, pool_id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 42fb1e11-5a8e-4484-b1d0-01348c83ab80, pool_id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: f03a2737-8c08-483e-a4f4-f8ed8fa49a5d, pool_id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 3f6bcd40-cd05-4431-8d69-2808eee08f83, pool_id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 49d61f83-4eb8-48e9-9996-9d66adaf9382, pool_id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2662024-11-13T20:40:24.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36461
2672024-11-13T20:40:24.036ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:884 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2682024-11-13T20:40:24.036ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: cad2b043-bf0f-4313-9a95-7117f0215aa3, pool_id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: aac79af1-9ba1-447c-af0b-f69098c37c58, pool_id: e43f0729-982f-4960-b10a-7966152ae48a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: f600988e-6b9d-4852-ab52-5da00c12c56e, pool_id: 94d47f77-b938-4683-89de-401156b9868f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 531ad966-4c71-4b15-b8f8-bedd182ade03, pool_id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 425238f0-d5fc-44bd-85fb-cf397621ab0e, pool_id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 42fb1e11-5a8e-4484-b1d0-01348c83ab80, pool_id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: f03a2737-8c08-483e-a4f4-f8ed8fa49a5d, pool_id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 3f6bcd40-cd05-4431-8d69-2808eee08f83, pool_id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 49d61f83-4eb8-48e9-9996-9d66adaf9382, pool_id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2692024-11-13T20:40:24.036ZINFOSledAgent (StorageManager): No ledger in /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-11-13T20:40:24.036ZINFOSledAgent (StorageManager): No ledger in /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-13T20:40:24.036ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2722024-11-13T20:40:24.036ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2732024-11-13T20:40:24.036ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2742024-11-13T20:40:24.036ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2752024-11-13T20:40:24.036ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2762024-11-13T20:40:24.169ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2772024-11-13T20:40:24.169ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool)
2782024-11-13T20:40:24.621ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2792024-11-13T20:40:24.838ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2802024-11-13T20:40:24.839ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2812024-11-13T20:40:24.839ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
2822024-11-13T20:40:24.886ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }
2832024-11-13T20:40:24.894ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2842024-11-13T20:40:24.894ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2852024-11-13T20:40:24.894ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2862024-11-13T20:40:24.894ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2872024-11-13T20:40:24.894ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-13T20:40:24.894ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-11-13T20:40:24.894ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2902024-11-13T20:40:24.930ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-11-13T20:40:24.938ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone file = sled-storage/src/dataset.rs:303
2922024-11-13T20:40:25.118ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_668784d0-9ec9-43d5-800e-a1a6d097030c file = sled-storage/src/dataset.rs:389
2932024-11-13T20:40:25.126ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2942024-11-13T20:40:25.126ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2952024-11-13T20:40:25.126ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2962024-11-13T20:40:25.126ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2972024-11-13T20:40:25.126ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2982024-11-13T20:40:25.136ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2992024-11-13T20:40:25.136ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e43f0729-982f-4960-b10a-7966152ae48a (zpool)
3002024-11-13T20:40:25.225ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }
3012024-11-13T20:40:25.233ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3022024-11-13T20:40:25.233ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3032024-11-13T20:40:25.233ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3042024-11-13T20:40:25.233ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3052024-11-13T20:40:25.233ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3062024-11-13T20:40:25.233ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-13T20:40:25.233ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3082024-11-13T20:40:25.269ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3092024-11-13T20:40:25.277ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e43f0729-982f-4960-b10a-7966152ae48a/crypt/zone file = sled-storage/src/dataset.rs:303
3102024-11-13T20:40:25.449ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e43f0729-982f-4960-b10a-7966152ae48a file = sled-storage/src/dataset.rs:389
3112024-11-13T20:40:25.457ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3122024-11-13T20:40:25.457ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3132024-11-13T20:40:25.457ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3142024-11-13T20:40:25.457ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3152024-11-13T20:40:25.457ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3162024-11-13T20:40:25.467ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3172024-11-13T20:40:25.467ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 94d47f77-b938-4683-89de-401156b9868f (zpool)
3182024-11-13T20:40:25.564ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }
3192024-11-13T20:40:25.572ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3202024-11-13T20:40:25.572ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3212024-11-13T20:40:25.572ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3222024-11-13T20:40:25.572ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3232024-11-13T20:40:25.572ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3242024-11-13T20:40:25.572ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-13T20:40:25.572ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3262024-11-13T20:40:25.609ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3272024-11-13T20:40:25.617ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_94d47f77-b938-4683-89de-401156b9868f/crypt/zone file = sled-storage/src/dataset.rs:303
3282024-11-13T20:40:25.623ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
3292024-11-13T20:40:25.794ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_94d47f77-b938-4683-89de-401156b9868f file = sled-storage/src/dataset.rs:389
3302024-11-13T20:40:25.802ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3312024-11-13T20:40:25.802ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3322024-11-13T20:40:25.802ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3332024-11-13T20:40:25.802ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3342024-11-13T20:40:25.802ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3352024-11-13T20:40:25.812ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3362024-11-13T20:40:25.813ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool)
3372024-11-13T20:40:25.907ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }
3382024-11-13T20:40:25.916ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3392024-11-13T20:40:25.916ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3402024-11-13T20:40:25.916ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3412024-11-13T20:40:25.916ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3422024-11-13T20:40:25.916ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-13T20:40:25.916ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-13T20:40:25.916ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3452024-11-13T20:40:25.952ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3462024-11-13T20:40:25.960ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/zone file = sled-storage/src/dataset.rs:303
3472024-11-13T20:40:26.135ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 file = sled-storage/src/dataset.rs:389
3482024-11-13T20:40:26.143ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3492024-11-13T20:40:26.143ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3502024-11-13T20:40:26.143ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3512024-11-13T20:40:26.143ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3522024-11-13T20:40:26.143ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3532024-11-13T20:40:26.153ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3542024-11-13T20:40:26.153ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool)
3552024-11-13T20:40:26.249ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }
3562024-11-13T20:40:26.259ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3572024-11-13T20:40:26.259ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3582024-11-13T20:40:26.259ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3592024-11-13T20:40:26.259ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3602024-11-13T20:40:26.259ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3612024-11-13T20:40:26.259ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-13T20:40:26.259ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3632024-11-13T20:40:26.263ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 14.925393292s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = b6e177bd-5357-4f01-b047-206109321c43
3642024-11-13T20:40:26.297ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3652024-11-13T20:40:26.305ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crypt/zone file = sled-storage/src/dataset.rs:303
3662024-11-13T20:40:26.477ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b file = sled-storage/src/dataset.rs:389
3672024-11-13T20:40:26.485ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3682024-11-13T20:40:26.485ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3692024-11-13T20:40:26.485ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3702024-11-13T20:40:26.485ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3712024-11-13T20:40:26.485ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3722024-11-13T20:40:26.495ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3732024-11-13T20:40:26.495ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool)
3742024-11-13T20:40:26.586ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }
3752024-11-13T20:40:26.594ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3762024-11-13T20:40:26.594ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3772024-11-13T20:40:26.594ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3782024-11-13T20:40:26.594ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3792024-11-13T20:40:26.594ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-13T20:40:26.594ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-11-13T20:40:26.594ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3822024-11-13T20:40:26.627ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
3832024-11-13T20:40:26.629ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3842024-11-13T20:40:26.637ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/zone file = sled-storage/src/dataset.rs:303
3852024-11-13T20:40:26.812ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2c90aa03-5691-4147-8289-5741cd7b19ba file = sled-storage/src/dataset.rs:389
3862024-11-13T20:40:26.820ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3872024-11-13T20:40:26.820ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3882024-11-13T20:40:26.820ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3892024-11-13T20:40:26.820ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3902024-11-13T20:40:26.820ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3912024-11-13T20:40:26.829ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3922024-11-13T20:40:26.829ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = df67e3ea-c363-421d-9d4f-d05175051931 (zpool)
3932024-11-13T20:40:26.926ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }
3942024-11-13T20:40:26.934ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3952024-11-13T20:40:26.934ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3962024-11-13T20:40:26.934ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3972024-11-13T20:40:26.934ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3982024-11-13T20:40:26.934ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-13T20:40:26.934ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4002024-11-13T20:40:26.934ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4012024-11-13T20:40:26.971ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4022024-11-13T20:40:26.979ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_df67e3ea-c363-421d-9d4f-d05175051931/crypt/zone file = sled-storage/src/dataset.rs:303
4032024-11-13T20:40:27.149ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_df67e3ea-c363-421d-9d4f-d05175051931 file = sled-storage/src/dataset.rs:389
4042024-11-13T20:40:27.158ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4052024-11-13T20:40:27.158ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4062024-11-13T20:40:27.158ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4072024-11-13T20:40:27.158ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4082024-11-13T20:40:27.158ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4092024-11-13T20:40:27.167ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4102024-11-13T20:40:27.167ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool)
4112024-11-13T20:40:27.259ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }
4122024-11-13T20:40:27.267ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4132024-11-13T20:40:27.267ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4142024-11-13T20:40:27.267ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4152024-11-13T20:40:27.267ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4162024-11-13T20:40:27.267ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-13T20:40:27.267ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4182024-11-13T20:40:27.267ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4192024-11-13T20:40:27.301ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4202024-11-13T20:40:27.310ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/zone file = sled-storage/src/dataset.rs:303
4212024-11-13T20:40:27.487ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2 file = sled-storage/src/dataset.rs:389
4222024-11-13T20:40:27.495ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-11-13T20:40:27.495ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-11-13T20:40:27.495ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-11-13T20:40:27.495ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-11-13T20:40:27.495ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-11-13T20:40:27.507ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-11-13T20:40:27.507ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool)
4292024-11-13T20:40:27.605ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }
4302024-11-13T20:40:27.613ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4312024-11-13T20:40:27.613ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4322024-11-13T20:40:27.613ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4332024-11-13T20:40:27.613ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4342024-11-13T20:40:27.613ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-13T20:40:27.613ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-13T20:40:27.613ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4372024-11-13T20:40:27.628ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
4382024-11-13T20:40:27.649ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4392024-11-13T20:40:27.657ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828/crypt/zone file = sled-storage/src/dataset.rs:303
4402024-11-13T20:40:27.834ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828 file = sled-storage/src/dataset.rs:389
4412024-11-13T20:40:27.842ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4422024-11-13T20:40:27.842ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4432024-11-13T20:40:27.842ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4442024-11-13T20:40:27.843ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b7cb2d93-67d8-40f4-ba66-b9d64de62594 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8bbfd2a1-1a2f-4810-a443-21874c43f88a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4452024-11-13T20:40:27.843ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4462024-11-13T20:40:27.843ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4472024-11-13T20:40:27.843ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4482024-11-13T20:40:27.843ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:888 sled_id = b6e177bd-5357-4f01-b047-206109321c43
4492024-11-13T20:40:27.843ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4502024-11-13T20:40:27.843ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:914 generation = Generation(1) sled_id = b6e177bd-5357-4f01-b047-206109321c43
4512024-11-13T20:40:27.843ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:919 sled_id = b6e177bd-5357-4f01-b047-206109321c43
4522024-11-13T20:40:27.843ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:924 sled_id = b6e177bd-5357-4f01-b047-206109321c43
4532024-11-13T20:40:27.843ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = b6e177bd-5357-4f01-b047-206109321c43
4542024-11-13T20:40:27.843ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:930 sled_id = b6e177bd-5357-4f01-b047-206109321c43
4552024-11-13T20:40:27.843ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4562024-11-13T20:40:27.843ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:935 sled_id = b6e177bd-5357-4f01-b047-206109321c43
4572024-11-13T20:40:27.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3807161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36461 req_id = b7587536-7206-4204-831c-620b46d9561b response_code = 200 uri = /omicron-physical-disks
4582024-11-13T20:40:27.874ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0707601c-b2dd-46a8-8514-f581ea21ca6a (dataset): DatasetConfig { id: 0707601c-b2dd-46a8-8514-f581ea21ca6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08f7359a-d446-4bbe-be6b-9e6e50f3309a (dataset): DatasetConfig { id: 08f7359a-d446-4bbe-be6b-9e6e50f3309a (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 099b8883-0dfe-44dc-b5a8-7b85c8cac2f2 (dataset): DatasetConfig { id: 099b8883-0dfe-44dc-b5a8-7b85c8cac2f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b18ade2-b82d-4b9f-9ff7-cb30117e4a94 (dataset): DatasetConfig { id: 0b18ade2-b82d-4b9f-9ff7-cb30117e4a94 (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15858896-bd1b-4e7f-b114-3acd70914e1c (dataset): DatasetConfig { id: 15858896-bd1b-4e7f-b114-3acd70914e1c (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1585e903-68e9-458c-8eb0-01f4d27e3d84 (dataset): DatasetConfig { id: 1585e903-68e9-458c-8eb0-01f4d27e3d84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17cb132a-71b3-4120-b745-c3f44dbf8bae (dataset): DatasetConfig { id: 17cb132a-71b3-4120-b745-c3f44dbf8bae (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17ed644d-f5ff-4bf3-9f69-206662d81aaa (dataset): DatasetConfig { id: 17ed644d-f5ff-4bf3-9f69-206662d81aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c9ec9e7-9829-4c5e-9a12-039a8069ef5a (dataset): DatasetConfig { id: 1c9ec9e7-9829-4c5e-9a12-039a8069ef5a (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e181794-c11b-4377-b5ad-048c04b2d8bd (dataset): DatasetConfig { id: 1e181794-c11b-4377-b5ad-048c04b2d8bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 221437df-d48d-4fbd-a692-8a63b20df932 (dataset): DatasetConfig { id: 221437df-d48d-4fbd-a692-8a63b20df932 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 225140b2-c0c5-4d88-aa8b-3921bb316602 (dataset): DatasetConfig { id: 225140b2-c0c5-4d88-aa8b-3921bb316602 (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24fd078f-0079-4737-a1cd-fa6cad0c4809 (dataset): DatasetConfig { id: 24fd078f-0079-4737-a1cd-fa6cad0c4809 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 262462cd-06ea-474d-aea1-7a11cff0dd59 (dataset): DatasetConfig { id: 262462cd-06ea-474d-aea1-7a11cff0dd59 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 275c7943-3bff-4b99-a873-2010b8757bd0 (dataset): DatasetConfig { id: 275c7943-3bff-4b99-a873-2010b8757bd0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2dba6a05-7eeb-4220-990e-c25d15a350de (dataset): DatasetConfig { id: 2dba6a05-7eeb-4220-990e-c25d15a350de (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3380ba08-3e98-41e3-9c53-dea63886499e (dataset): DatasetConfig { id: 3380ba08-3e98-41e3-9c53-dea63886499e (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35ac9b30-900a-4de2-933c-56075bcf5fe7 (dataset): DatasetConfig { id: 35ac9b30-900a-4de2-933c-56075bcf5fe7 (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e4d2509-8d26-4889-9f4b-61589107020e (dataset): DatasetConfig { id: 3e4d2509-8d26-4889-9f4b-61589107020e (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 436cd612-f41d-4044-b66f-21aa60221561 (dataset): DatasetConfig { id: 436cd612-f41d-4044-b66f-21aa60221561 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 445f527e-a921-4a4a-9839-73c81ffabf3a (dataset): DatasetConfig { id: 445f527e-a921-4a4a-9839-73c81ffabf3a (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46a3bd09-72f2-44ec-9eed-9b9dfa9ec932 (dataset): DatasetConfig { id: 46a3bd09-72f2-44ec-9eed-9b9dfa9ec932 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46d7a767-b0a0-4ed5-b1cc-7b2c2e6fbe7d (dataset): DatasetConfig { id: 46d7a767-b0a0-4ed5-b1cc-7b2c2e6fbe7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bc4e980-53ff-4623-964e-47594ebea8b3 (dataset): DatasetConfig { id: 4bc4e980-53ff-4623-964e-47594ebea8b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5060a754-fac5-4af7-b68e-180937fc5257 (dataset): DatasetConfig { id: 5060a754-fac5-4af7-b68e-180937fc5257 (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55fc3a6c-a04f-4b34-bad9-9a2fdc0eff60 (dataset): DatasetConfig { id: 55fc3a6c-a04f-4b34-bad9-9a2fdc0eff60 (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 574e0354-fda9-47ed-94e6-031da7e72758 (dataset): DatasetConfig { id: 574e0354-fda9-47ed-94e6-031da7e72758 (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 581834dd-615b-4c01-95ba-706de9eb379a (dataset): DatasetConfig { id: 581834dd-615b-4c01-95ba-706de9eb379a (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58398038-228c-42c2-833b-4d917f703142 (dataset): DatasetConfig { id: 58398038-228c-42c2-833b-4d917f703142 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5872715b-f6fd-4b3d-b818-f139326dd8f2 (dataset): DatasetConfig { id: 5872715b-f6fd-4b3d-b818-f139326dd8f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bcb9a90-81f0-4c2e-98e4-88d2ddcffac6 (dataset): DatasetConfig { id: 5bcb9a90-81f0-4c2e-98e4-88d2ddcffac6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6343d961-7d8a-4212-85b0-c4bc7dbad2f6 (dataset): DatasetConfig { id: 6343d961-7d8a-4212-85b0-c4bc7dbad2f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63e9caa1-de97-4aa2-9d39-c3f98806a336 (dataset): DatasetConfig { id: 63e9caa1-de97-4aa2-9d39-c3f98806a336 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c6223705-7a45-4833-a879-76764209ac90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cd525bd-a743-4c2b-aab1-26eb0dbf331d (dataset): DatasetConfig { id: 6cd525bd-a743-4c2b-aab1-26eb0dbf331d (dataset), name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d8c460c-148d-4e51-bdb9-cc9e8a2ae891 (dataset): DatasetConfig { id: 6d8c460c-148d-4e51-bdb9-cc9e8a2ae891 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 79d781a3-568b-4496-9fbc-e0f9e0596b0c (dataset): DatasetConfig { id: 79d781a3-568b-4496-9fbc-e0f9e0596b0c (dataset), name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7be9a12b-5209-4f76-86a2-d7f81054a4f4 (dataset): DatasetConfig { id: 7be9a12b-5209-4f76-86a2-d7f81054a4f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c8c757c-7a57-4de6-8ace-c38bd6064cb6 (dataset): DatasetConfig { id: 7c8c757c-7a57-4de6-8ace-c38bd6064cb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84f97195-d36f-4d3e-83d8-2c144c63c3ff (dataset): DatasetConfig { id: 84f97195-d36f-4d3e-83d8-2c144c63c3ff (dataset), name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 867a8248-63d2-48d5-b4a2-ea264e2fa5d8 (dataset): DatasetConfig { id: 867a8248-63d2-48d5-b4a2-ea264e2fa5d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a2dd447-b673-481b-adf9-ccde20665818 (dataset): DatasetConfig { id: 8a2dd447-b673-481b-adf9-ccde20665818 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90cb6f0c-327c-4287-8f6c-4f195374b65e (dataset): DatasetConfig { id: 90cb6f0c-327c-4287-8f6c-4f195374b65e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3293a1f-5338-46ca-b675-01f38bfbb488 (dataset): DatasetConfig { id: a3293a1f-5338-46ca-b675-01f38bfbb488 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a439edfa-9bc6-404c-84fe-7ed4fc24447d (dataset): DatasetConfig { id: a439edfa-9bc6-404c-84fe-7ed4fc24447d (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8ded509-dee0-4bd4-899e-c751101fa58b (dataset): DatasetConfig { id: a8ded509-dee0-4bd4-899e-c751101fa58b (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa22be3f-b1c5-427d-bd0c-d26e54a7da40 (dataset): DatasetConfig { id: aa22be3f-b1c5-427d-bd0c-d26e54a7da40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b10c7a16-89ea-45f9-b842-2ee99f599b1e (dataset): DatasetConfig { id: b10c7a16-89ea-45f9-b842-2ee99f599b1e (dataset), name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b534b7a4-4d65-40a7-a78c-56bf4bff55d7 (dataset): DatasetConfig { id: b534b7a4-4d65-40a7-a78c-56bf4bff55d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcaa06cf-50f7-4e99-bc42-aaa49b3a93d5 (dataset): DatasetConfig { id: bcaa06cf-50f7-4e99-bc42-aaa49b3a93d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c247f615-0d03-44ee-ba16-c2dd94200e24 (dataset): DatasetConfig { id: c247f615-0d03-44ee-ba16-c2dd94200e24 (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2a6bd79-afe7-4ced-9ff6-93eac4e6ec7a (dataset): DatasetConfig { id: c2a6bd79-afe7-4ced-9ff6-93eac4e6ec7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c61ce5d6-bffd-46ff-a7a9-588e7d3c126a (dataset): DatasetConfig { id: c61ce5d6-bffd-46ff-a7a9-588e7d3c126a (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c8836d27-bcfe-4e57-98a1-37431b63d743 (dataset): DatasetConfig { id: c8836d27-bcfe-4e57-98a1-37431b63d743 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9d40ba0-e4e4-4db0-bd89-29759804a7bc (dataset): DatasetConfig { id: c9d40ba0-e4e4-4db0-bd89-29759804a7bc (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d37302ba-6d1a-4a00-bd75-f954896569ea (dataset): DatasetConfig { id: d37302ba-6d1a-4a00-bd75-f954896569ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4e948d4-44bf-47d7-a80e-f720fa451aca (dataset): DatasetConfig { id: d4e948d4-44bf-47d7-a80e-f720fa451aca (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d757b4d7-5718-44ea-9bb9-ef8b8639af4d (dataset): DatasetConfig { id: d757b4d7-5718-44ea-9bb9-ef8b8639af4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7b4f6e8-6526-4e8a-accd-9c65c0e32082 (dataset): DatasetConfig { id: d7b4f6e8-6526-4e8a-accd-9c65c0e32082 (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da68b1f5-3e0d-4f60-81a5-867269a664bd (dataset): DatasetConfig { id: da68b1f5-3e0d-4f60-81a5-867269a664bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbb02fbf-a8c9-4e1a-bffa-a45d688b530d (dataset): DatasetConfig { id: dbb02fbf-a8c9-4e1a-bffa-a45d688b530d (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eef943e6-d153-4d88-9fc6-06bfb0bf943c (dataset): DatasetConfig { id: eef943e6-d153-4d88-9fc6-06bfb0bf943c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2a9abcd-6e06-4158-9d9e-5a0e8531f643 (dataset): DatasetConfig { id: f2a9abcd-6e06-4158-9d9e-5a0e8531f643 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f48eb2d9-594f-49d3-840e-f977feae5d7f (dataset): DatasetConfig { id: f48eb2d9-594f-49d3-840e-f977feae5d7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f812c541-03ce-4336-8f9b-cf76bc05cbe2 (dataset): DatasetConfig { id: f812c541-03ce-4336-8f9b-cf76bc05cbe2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbef203f-7b90-4803-81a8-f1466b6c79ab (dataset): DatasetConfig { id: fbef203f-7b90-4803-81a8-f1466b6c79ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdb6f076-95cc-40ab-a193-c91978aa0cdc (dataset): DatasetConfig { id: fdb6f076-95cc-40ab-a193-c91978aa0cdc (dataset), name: DatasetName { pool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4592024-11-13T20:40:27.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63846
4602024-11-13T20:40:27.875ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:850 sled_id = b6e177bd-5357-4f01-b047-206109321c43
4612024-11-13T20:40:27.875ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0707601c-b2dd-46a8-8514-f581ea21ca6a (dataset): DatasetConfig { id: 0707601c-b2dd-46a8-8514-f581ea21ca6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08f7359a-d446-4bbe-be6b-9e6e50f3309a (dataset): DatasetConfig { id: 08f7359a-d446-4bbe-be6b-9e6e50f3309a (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 099b8883-0dfe-44dc-b5a8-7b85c8cac2f2 (dataset): DatasetConfig { id: 099b8883-0dfe-44dc-b5a8-7b85c8cac2f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b18ade2-b82d-4b9f-9ff7-cb30117e4a94 (dataset): DatasetConfig { id: 0b18ade2-b82d-4b9f-9ff7-cb30117e4a94 (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15858896-bd1b-4e7f-b114-3acd70914e1c (dataset): DatasetConfig { id: 15858896-bd1b-4e7f-b114-3acd70914e1c (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1585e903-68e9-458c-8eb0-01f4d27e3d84 (dataset): DatasetConfig { id: 1585e903-68e9-458c-8eb0-01f4d27e3d84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17cb132a-71b3-4120-b745-c3f44dbf8bae (dataset): DatasetConfig { id: 17cb132a-71b3-4120-b745-c3f44dbf8bae (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17ed644d-f5ff-4bf3-9f69-206662d81aaa (dataset): DatasetConfig { id: 17ed644d-f5ff-4bf3-9f69-206662d81aaa (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c9ec9e7-9829-4c5e-9a12-039a8069ef5a (dataset): DatasetConfig { id: 1c9ec9e7-9829-4c5e-9a12-039a8069ef5a (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e181794-c11b-4377-b5ad-048c04b2d8bd (dataset): DatasetConfig { id: 1e181794-c11b-4377-b5ad-048c04b2d8bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 221437df-d48d-4fbd-a692-8a63b20df932 (dataset): DatasetConfig { id: 221437df-d48d-4fbd-a692-8a63b20df932 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 225140b2-c0c5-4d88-aa8b-3921bb316602 (dataset): DatasetConfig { id: 225140b2-c0c5-4d88-aa8b-3921bb316602 (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24fd078f-0079-4737-a1cd-fa6cad0c4809 (dataset): DatasetConfig { id: 24fd078f-0079-4737-a1cd-fa6cad0c4809 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 262462cd-06ea-474d-aea1-7a11cff0dd59 (dataset): DatasetConfig { id: 262462cd-06ea-474d-aea1-7a11cff0dd59 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 275c7943-3bff-4b99-a873-2010b8757bd0 (dataset): DatasetConfig { id: 275c7943-3bff-4b99-a873-2010b8757bd0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2dba6a05-7eeb-4220-990e-c25d15a350de (dataset): DatasetConfig { id: 2dba6a05-7eeb-4220-990e-c25d15a350de (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3380ba08-3e98-41e3-9c53-dea63886499e (dataset): DatasetConfig { id: 3380ba08-3e98-41e3-9c53-dea63886499e (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35ac9b30-900a-4de2-933c-56075bcf5fe7 (dataset): DatasetConfig { id: 35ac9b30-900a-4de2-933c-56075bcf5fe7 (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e4d2509-8d26-4889-9f4b-61589107020e (dataset): DatasetConfig { id: 3e4d2509-8d26-4889-9f4b-61589107020e (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 436cd612-f41d-4044-b66f-21aa60221561 (dataset): DatasetConfig { id: 436cd612-f41d-4044-b66f-21aa60221561 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 445f527e-a921-4a4a-9839-73c81ffabf3a (dataset): DatasetConfig { id: 445f527e-a921-4a4a-9839-73c81ffabf3a (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46a3bd09-72f2-44ec-9eed-9b9dfa9ec932 (dataset): DatasetConfig { id: 46a3bd09-72f2-44ec-9eed-9b9dfa9ec932 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46d7a767-b0a0-4ed5-b1cc-7b2c2e6fbe7d (dataset): DatasetConfig { id: 46d7a767-b0a0-4ed5-b1cc-7b2c2e6fbe7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bc4e980-53ff-4623-964e-47594ebea8b3 (dataset): DatasetConfig { id: 4bc4e980-53ff-4623-964e-47594ebea8b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5060a754-fac5-4af7-b68e-180937fc5257 (dataset): DatasetConfig { id: 5060a754-fac5-4af7-b68e-180937fc5257 (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55fc3a6c-a04f-4b34-bad9-9a2fdc0eff60 (dataset): DatasetConfig { id: 55fc3a6c-a04f-4b34-bad9-9a2fdc0eff60 (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 574e0354-fda9-47ed-94e6-031da7e72758 (dataset): DatasetConfig { id: 574e0354-fda9-47ed-94e6-031da7e72758 (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 581834dd-615b-4c01-95ba-706de9eb379a (dataset): DatasetConfig { id: 581834dd-615b-4c01-95ba-706de9eb379a (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58398038-228c-42c2-833b-4d917f703142 (dataset): DatasetConfig { id: 58398038-228c-42c2-833b-4d917f703142 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5872715b-f6fd-4b3d-b818-f139326dd8f2 (dataset): DatasetConfig { id: 5872715b-f6fd-4b3d-b818-f139326dd8f2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bcb9a90-81f0-4c2e-98e4-88d2ddcffac6 (dataset): DatasetConfig { id: 5bcb9a90-81f0-4c2e-98e4-88d2ddcffac6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6343d961-7d8a-4212-85b0-c4bc7dbad2f6 (dataset): DatasetConfig { id: 6343d961-7d8a-4212-85b0-c4bc7dbad2f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63e9caa1-de97-4aa2-9d39-c3f98806a336 (dataset): DatasetConfig { id: 63e9caa1-de97-4aa2-9d39-c3f98806a336 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c6223705-7a45-4833-a879-76764209ac90" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cd525bd-a743-4c2b-aab1-26eb0dbf331d (dataset): DatasetConfig { id: 6cd525bd-a743-4c2b-aab1-26eb0dbf331d (dataset), name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d8c460c-148d-4e51-bdb9-cc9e8a2ae891 (dataset): DatasetConfig { id: 6d8c460c-148d-4e51-bdb9-cc9e8a2ae891 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 79d781a3-568b-4496-9fbc-e0f9e0596b0c (dataset): DatasetConfig { id: 79d781a3-568b-4496-9fbc-e0f9e0596b0c (dataset), name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7be9a12b-5209-4f76-86a2-d7f81054a4f4 (dataset): DatasetConfig { id: 7be9a12b-5209-4f76-86a2-d7f81054a4f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c8c757c-7a57-4de6-8ace-c38bd6064cb6 (dataset): DatasetConfig { id: 7c8c757c-7a57-4de6-8ace-c38bd6064cb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84f97195-d36f-4d3e-83d8-2c144c63c3ff (dataset): DatasetConfig { id: 84f97195-d36f-4d3e-83d8-2c144c63c3ff (dataset), name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 867a8248-63d2-48d5-b4a2-ea264e2fa5d8 (dataset): DatasetConfig { id: 867a8248-63d2-48d5-b4a2-ea264e2fa5d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a2dd447-b673-481b-adf9-ccde20665818 (dataset): DatasetConfig { id: 8a2dd447-b673-481b-adf9-ccde20665818 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90cb6f0c-327c-4287-8f6c-4f195374b65e (dataset): DatasetConfig { id: 90cb6f0c-327c-4287-8f6c-4f195374b65e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3293a1f-5338-46ca-b675-01f38bfbb488 (dataset): DatasetConfig { id: a3293a1f-5338-46ca-b675-01f38bfbb488 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a439edfa-9bc6-404c-84fe-7ed4fc24447d (dataset): DatasetConfig { id: a439edfa-9bc6-404c-84fe-7ed4fc24447d (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8ded509-dee0-4bd4-899e-c751101fa58b (dataset): DatasetConfig { id: a8ded509-dee0-4bd4-899e-c751101fa58b (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa22be3f-b1c5-427d-bd0c-d26e54a7da40 (dataset): DatasetConfig { id: aa22be3f-b1c5-427d-bd0c-d26e54a7da40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b10c7a16-89ea-45f9-b842-2ee99f599b1e (dataset): DatasetConfig { id: b10c7a16-89ea-45f9-b842-2ee99f599b1e (dataset), name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b534b7a4-4d65-40a7-a78c-56bf4bff55d7 (dataset): DatasetConfig { id: b534b7a4-4d65-40a7-a78c-56bf4bff55d7 (dataset), name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcaa06cf-50f7-4e99-bc42-aaa49b3a93d5 (dataset): DatasetConfig { id: bcaa06cf-50f7-4e99-bc42-aaa49b3a93d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c247f615-0d03-44ee-ba16-c2dd94200e24 (dataset): DatasetConfig { id: c247f615-0d03-44ee-ba16-c2dd94200e24 (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2a6bd79-afe7-4ced-9ff6-93eac4e6ec7a (dataset): DatasetConfig { id: c2a6bd79-afe7-4ced-9ff6-93eac4e6ec7a (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c61ce5d6-bffd-46ff-a7a9-588e7d3c126a (dataset): DatasetConfig { id: c61ce5d6-bffd-46ff-a7a9-588e7d3c126a (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c8836d27-bcfe-4e57-98a1-37431b63d743 (dataset): DatasetConfig { id: c8836d27-bcfe-4e57-98a1-37431b63d743 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9d40ba0-e4e4-4db0-bd89-29759804a7bc (dataset): DatasetConfig { id: c9d40ba0-e4e4-4db0-bd89-29759804a7bc (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d37302ba-6d1a-4a00-bd75-f954896569ea (dataset): DatasetConfig { id: d37302ba-6d1a-4a00-bd75-f954896569ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4e948d4-44bf-47d7-a80e-f720fa451aca (dataset): DatasetConfig { id: d4e948d4-44bf-47d7-a80e-f720fa451aca (dataset), name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d757b4d7-5718-44ea-9bb9-ef8b8639af4d (dataset): DatasetConfig { id: d757b4d7-5718-44ea-9bb9-ef8b8639af4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7b4f6e8-6526-4e8a-accd-9c65c0e32082 (dataset): DatasetConfig { id: d7b4f6e8-6526-4e8a-accd-9c65c0e32082 (dataset), name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da68b1f5-3e0d-4f60-81a5-867269a664bd (dataset): DatasetConfig { id: da68b1f5-3e0d-4f60-81a5-867269a664bd (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dbb02fbf-a8c9-4e1a-bffa-a45d688b530d (dataset): DatasetConfig { id: dbb02fbf-a8c9-4e1a-bffa-a45d688b530d (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eef943e6-d153-4d88-9fc6-06bfb0bf943c (dataset): DatasetConfig { id: eef943e6-d153-4d88-9fc6-06bfb0bf943c (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2a9abcd-6e06-4158-9d9e-5a0e8531f643 (dataset): DatasetConfig { id: f2a9abcd-6e06-4158-9d9e-5a0e8531f643 (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f48eb2d9-594f-49d3-840e-f977feae5d7f (dataset): DatasetConfig { id: f48eb2d9-594f-49d3-840e-f977feae5d7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f812c541-03ce-4336-8f9b-cf76bc05cbe2 (dataset): DatasetConfig { id: f812c541-03ce-4336-8f9b-cf76bc05cbe2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbef203f-7b90-4803-81a8-f1466b6c79ab (dataset): DatasetConfig { id: fbef203f-7b90-4803-81a8-f1466b6c79ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdb6f076-95cc-40ab-a193-c91978aa0cdc (dataset): DatasetConfig { id: fdb6f076-95cc-40ab-a193-c91978aa0cdc (dataset), name: DatasetName { pool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4622024-11-13T20:40:27.875ZINFOSledAgent (StorageManager): No ledger in /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4632024-11-13T20:40:27.875ZINFOSledAgent (StorageManager): No ledger in /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4642024-11-13T20:40:27.875ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4652024-11-13T20:40:27.875ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4662024-11-13T20:40:27.875ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_94d47f77-b938-4683-89de-401156b9868f/crucible" } file = sled-storage/src/manager.rs:1331
4672024-11-13T20:40:27.965ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-11-13T20:40:27.965ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4692024-11-13T20:40:28.059ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-11-13T20:40:28.059ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828/crucible" } file = sled-storage/src/manager.rs:1331
4712024-11-13T20:40:28.149ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4722024-11-13T20:40:28.149ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crucible" } file = sled-storage/src/manager.rs:1331
4732024-11-13T20:40:28.239ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-11-13T20:40:28.239ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/zone/oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101"), full_name: "oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/zone/oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101" } file = sled-storage/src/manager.rs:1331
4752024-11-13T20:40:28.339ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-11-13T20:40:28.339ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/zone/oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97"), full_name: "oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/zone/oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97" } file = sled-storage/src/manager.rs:1331
4772024-11-13T20:40:28.440ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-11-13T20:40:28.440ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/zone"), full_name: "oxp_2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/zone" } file = sled-storage/src/manager.rs:1331
4792024-11-13T20:40:28.509ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-11-13T20:40:28.509ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_94d47f77-b938-4683-89de-401156b9868f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4812024-11-13T20:40:28.597ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-11-13T20:40:28.597ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076" } file = sled-storage/src/manager.rs:1331
4832024-11-13T20:40:28.630ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
4842024-11-13T20:40:28.696ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852024-11-13T20:40:28.696ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crypt/zone"), full_name: "oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crypt/zone" } file = sled-storage/src/manager.rs:1331
4862024-11-13T20:40:28.764ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4872024-11-13T20:40:28.764ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crucible" } file = sled-storage/src/manager.rs:1331
4882024-11-13T20:40:28.852ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4892024-11-13T20:40:28.852ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/zone/oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db"), full_name: "oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/zone/oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db" } file = sled-storage/src/manager.rs:1331
4902024-11-13T20:40:28.949ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-11-13T20:40:28.949ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5d5794b-cd37-472d-aa32-7a4b9d8ee828/crypt/debug"), full_name: "oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828/crypt/debug" } file = sled-storage/src/manager.rs:1331
4922024-11-13T20:40:29.016ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-11-13T20:40:29.017ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4942024-11-13T20:40:29.108ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-11-13T20:40:29.108ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crypt/zone/oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e"), full_name: "oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crypt/zone/oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e" } file = sled-storage/src/manager.rs:1331
4962024-11-13T20:40:29.208ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-11-13T20:40:29.208ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4982024-11-13T20:40:29.300ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-11-13T20:40:29.300ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690" } file = sled-storage/src/manager.rs:1331
5002024-11-13T20:40:29.400ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-11-13T20:40:29.400ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e43f0729-982f-4960-b10a-7966152ae48a/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5022024-11-13T20:40:29.487ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-11-13T20:40:29.487ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/debug"), full_name: "oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/debug" } file = sled-storage/src/manager.rs:1331
5042024-11-13T20:40:29.555ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-11-13T20:40:29.555ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/zone/oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd"), full_name: "oxp_2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/zone/oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd" } file = sled-storage/src/manager.rs:1331
5062024-11-13T20:40:29.633ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
5072024-11-13T20:40:29.657ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5082024-11-13T20:40:29.657ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e43f0729-982f-4960-b10a-7966152ae48a/crypt/zone"), full_name: "oxp_e43f0729-982f-4960-b10a-7966152ae48a/crypt/zone" } file = sled-storage/src/manager.rs:1331
5092024-11-13T20:40:29.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5102024-11-13T20:40:29.727ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/zone"), full_name: "oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/zone" } file = sled-storage/src/manager.rs:1331
5112024-11-13T20:40:29.796ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5122024-11-13T20:40:29.796ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crucible" } file = sled-storage/src/manager.rs:1331
5132024-11-13T20:40:29.885ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5142024-11-13T20:40:29.885ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/debug"), full_name: "oxp_2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/debug" } file = sled-storage/src/manager.rs:1331
5152024-11-13T20:40:29.952ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5162024-11-13T20:40:29.952ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e43f0729-982f-4960-b10a-7966152ae48a/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5172024-11-13T20:40:30.043ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-11-13T20:40:30.043ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e43f0729-982f-4960-b10a-7966152ae48a/crypt/zone/oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d"), full_name: "oxp_e43f0729-982f-4960-b10a-7966152ae48a/crypt/zone/oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d" } file = sled-storage/src/manager.rs:1331
5192024-11-13T20:40:30.147ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-11-13T20:40:30.147ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e43f0729-982f-4960-b10a-7966152ae48a/crypt/zone/oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934"), full_name: "oxp_e43f0729-982f-4960-b10a-7966152ae48a/crypt/zone/oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934" } file = sled-storage/src/manager.rs:1331
5212024-11-13T20:40:30.247ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-11-13T20:40:30.247ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/94d47f77-b938-4683-89de-401156b9868f/crypt/zone"), full_name: "oxp_94d47f77-b938-4683-89de-401156b9868f/crypt/zone" } file = sled-storage/src/manager.rs:1331
5232024-11-13T20:40:30.317ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-11-13T20:40:30.317ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/zone/oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013"), full_name: "oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/zone/oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013" } file = sled-storage/src/manager.rs:1331
5252024-11-13T20:40:30.421ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-11-13T20:40:30.421ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone" } file = sled-storage/src/manager.rs:1331
5272024-11-13T20:40:30.490ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-11-13T20:40:30.490ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/94d47f77-b938-4683-89de-401156b9868f/crypt/zone/oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf"), full_name: "oxp_94d47f77-b938-4683-89de-401156b9868f/crypt/zone/oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf" } file = sled-storage/src/manager.rs:1331
5292024-11-13T20:40:30.591ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-11-13T20:40:30.591ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/zone/oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de"), full_name: "oxp_2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/zone/oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de" } file = sled-storage/src/manager.rs:1331
5312024-11-13T20:40:30.635ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
5322024-11-13T20:40:30.689ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5332024-11-13T20:40:30.689ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/zone/oxz_crucible_c6223705-7a45-4833-a879-76764209ac90"), full_name: "oxp_2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/zone/oxz_crucible_c6223705-7a45-4833-a879-76764209ac90" } file = sled-storage/src/manager.rs:1331
5342024-11-13T20:40:30.791ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5352024-11-13T20:40:30.791ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df67e3ea-c363-421d-9d4f-d05175051931/crypt/zone"), full_name: "oxp_df67e3ea-c363-421d-9d4f-d05175051931/crypt/zone" } file = sled-storage/src/manager.rs:1331
5362024-11-13T20:40:30.862ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5372024-11-13T20:40:30.862ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/debug"), full_name: "oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/debug" } file = sled-storage/src/manager.rs:1331
5382024-11-13T20:40:30.932ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5392024-11-13T20:40:30.932ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df67e3ea-c363-421d-9d4f-d05175051931/crypt/zone/oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af"), full_name: "oxp_df67e3ea-c363-421d-9d4f-d05175051931/crypt/zone/oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af" } file = sled-storage/src/manager.rs:1331
5402024-11-13T20:40:31.034ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-11-13T20:40:31.034ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e43f0729-982f-4960-b10a-7966152ae48a/crypt/zone/oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), full_name: "oxp_e43f0729-982f-4960-b10a-7966152ae48a/crypt/zone/oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23" } file = sled-storage/src/manager.rs:1331
5422024-11-13T20:40:31.140ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-11-13T20:40:31.140ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629" } file = sled-storage/src/manager.rs:1331
5442024-11-13T20:40:31.241ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-11-13T20:40:31.242ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df67e3ea-c363-421d-9d4f-d05175051931/crypt/debug"), full_name: "oxp_df67e3ea-c363-421d-9d4f-d05175051931/crypt/debug" } file = sled-storage/src/manager.rs:1331
5462024-11-13T20:40:31.311ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-11-13T20:40:31.311ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/94d47f77-b938-4683-89de-401156b9868f/crypt/zone/oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b"), full_name: "oxp_94d47f77-b938-4683-89de-401156b9868f/crypt/zone/oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b" } file = sled-storage/src/manager.rs:1331
5482024-11-13T20:40:31.411ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-11-13T20:40:31.411ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5502024-11-13T20:40:31.502ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-11-13T20:40:31.503ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2c90aa03-5691-4147-8289-5741cd7b19ba/crucible" } file = sled-storage/src/manager.rs:1331
5522024-11-13T20:40:31.594ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-11-13T20:40:31.594ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crypt/zone/oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3"), full_name: "oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crypt/zone/oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3" } file = sled-storage/src/manager.rs:1331
5542024-11-13T20:40:31.638ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
5552024-11-13T20:40:31.694ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-11-13T20:40:31.694ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/94d47f77-b938-4683-89de-401156b9868f/crypt/zone/oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e"), full_name: "oxp_94d47f77-b938-4683-89de-401156b9868f/crypt/zone/oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e" } file = sled-storage/src/manager.rs:1331
5572024-11-13T20:40:31.797ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5582024-11-13T20:40:31.797ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e43f0729-982f-4960-b10a-7966152ae48a/crypt/zone/oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848"), full_name: "oxp_e43f0729-982f-4960-b10a-7966152ae48a/crypt/zone/oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848" } file = sled-storage/src/manager.rs:1331
5592024-11-13T20:40:31.896ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5602024-11-13T20:40:31.896ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5612024-11-13T20:40:31.987ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5622024-11-13T20:40:31.987ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/df67e3ea-c363-421d-9d4f-d05175051931/crypt/zone/oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), full_name: "oxp_df67e3ea-c363-421d-9d4f-d05175051931/crypt/zone/oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc" } file = sled-storage/src/manager.rs:1331
5632024-11-13T20:40:32.095ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-11-13T20:40:32.095ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_df67e3ea-c363-421d-9d4f-d05175051931/crucible" } file = sled-storage/src/manager.rs:1331
5652024-11-13T20:40:32.185ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-11-13T20:40:32.185ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crypt/debug"), full_name: "oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crypt/debug" } file = sled-storage/src/manager.rs:1331
5672024-11-13T20:40:32.254ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-11-13T20:40:32.254ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/zone"), full_name: "oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/zone" } file = sled-storage/src/manager.rs:1331
5692024-11-13T20:40:32.320ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-11-13T20:40:32.320ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/debug"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/debug" } file = sled-storage/src/manager.rs:1331
5712024-11-13T20:40:32.389ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-11-13T20:40:32.389ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e43f0729-982f-4960-b10a-7966152ae48a/crypt/debug"), full_name: "oxp_e43f0729-982f-4960-b10a-7966152ae48a/crypt/debug" } file = sled-storage/src/manager.rs:1331
5732024-11-13T20:40:32.483ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5742024-11-13T20:40:32.483ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8" } file = sled-storage/src/manager.rs:1331
5752024-11-13T20:40:32.549ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5762024-11-13T20:40:32.549ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5772024-11-13T20:40:32.556ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5782024-11-13T20:40:32.556ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5792024-11-13T20:40:32.597ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5802024-11-13T20:40:32.597ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e43f0729-982f-4960-b10a-7966152ae48a/crucible" } file = sled-storage/src/manager.rs:1331
5812024-11-13T20:40:32.640ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
5822024-11-13T20:40:32.706ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5832024-11-13T20:40:32.706ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/zone/oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee"), full_name: "oxp_2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/zone/oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee" } file = sled-storage/src/manager.rs:1331
5842024-11-13T20:40:32.712ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
5852024-11-13T20:40:32.712ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
5862024-11-13T20:40:32.760ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
5872024-11-13T20:40:32.760ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
5882024-11-13T20:40:32.815ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
5892024-11-13T20:40:32.815ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
5902024-11-13T20:40:32.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5912024-11-13T20:40:32.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e43f0729-982f-4960-b10a-7966152ae48a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5922024-11-13T20:40:32.838ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
5932024-11-13T20:40:32.838ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
5942024-11-13T20:40:32.912ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
5952024-11-13T20:40:32.912ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
5962024-11-13T20:40:32.929ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5972024-11-13T20:40:32.929ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crucible" } file = sled-storage/src/manager.rs:1331
5982024-11-13T20:40:33.010ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
5992024-11-13T20:40:33.010ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6002024-11-13T20:40:33.026ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6012024-11-13T20:40:33.026ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/zone/oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e"), full_name: "oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/zone/oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e" } file = sled-storage/src/manager.rs:1331
6022024-11-13T20:40:33.052ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6032024-11-13T20:40:33.053ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/nexus.rs:527 sled_id = b6e177bd-5357-4f01-b047-206109321c43
6042024-11-13T20:40:33.094ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6052024-11-13T20:40:33.094ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6062024-11-13T20:40:33.094ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
6072024-11-13T20:40:33.094ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6082024-11-13T20:40:33.132ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6092024-11-13T20:40:33.132ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_94d47f77-b938-4683-89de-401156b9868f/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
6102024-11-13T20:40:33.147ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6112024-11-13T20:40:33.233ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6122024-11-13T20:40:33.233ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
6132024-11-13T20:40:33.327ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6142024-11-13T20:40:33.327ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/zone/oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c"), full_name: "oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/zone/oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c" } file = sled-storage/src/manager.rs:1331
6152024-11-13T20:40:33.386ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16888347489167188368 sled_id = b6e177bd-5357-4f01-b047-206109321c43
6162024-11-13T20:40:33.386ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 209156185978600993 sled_id = b6e177bd-5357-4f01-b047-206109321c43
6172024-11-13T20:40:33.428ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6182024-11-13T20:40:33.428ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5" } file = sled-storage/src/manager.rs:1331
6192024-11-13T20:40:33.533ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6202024-11-13T20:40:33.533ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/94d47f77-b938-4683-89de-401156b9868f/crypt/debug"), full_name: "oxp_94d47f77-b938-4683-89de-401156b9868f/crypt/debug" } file = sled-storage/src/manager.rs:1331
6212024-11-13T20:40:33.604ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6222024-11-13T20:40:33.604ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5d5794b-cd37-472d-aa32-7a4b9d8ee828/crypt/zone"), full_name: "oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828/crypt/zone" } file = sled-storage/src/manager.rs:1331
6232024-11-13T20:40:33.644ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
6242024-11-13T20:40:33.676ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6252024-11-13T20:40:33.676ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde"), full_name: "oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/zone/oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde" } file = sled-storage/src/manager.rs:1331
6262024-11-13T20:40:33.778ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6272024-11-13T20:40:33.778ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5d5794b-cd37-472d-aa32-7a4b9d8ee828/crypt/zone/oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b"), full_name: "oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828/crypt/zone/oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b" } file = sled-storage/src/manager.rs:1331
6282024-11-13T20:40:33.877ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6292024-11-13T20:40:33.877ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6302024-11-13T20:40:33.878ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6312024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6322024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6332024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6342024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6352024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6362024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6372024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6382024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6392024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6402024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6412024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6422024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6432024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6442024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6452024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6462024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6472024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6482024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6492024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6502024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6512024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6522024-11-13T20:40:33.878ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6532024-11-13T20:40:33.878ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:852 sled_id = b6e177bd-5357-4f01-b047-206109321c43
6542024-11-13T20:40:33.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6003383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:63846 req_id = 514056d3-c500-4fa7-a69c-1fa948e94331 response_code = 200 uri = /datasets
6552024-11-13T20:40:33.909ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5 (service), filesystem_pool: Some(ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d4e011e5-fef3-4800-b7bf-7c88d30de48d (service), filesystem_pool: Some(ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a56b6300-0795-4c14-8877-adb08dfee79b (service), filesystem_pool: Some(ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6562024-11-13T20:40:33.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54307
6572024-11-13T20:40:33.909ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6582024-11-13T20:40:33.909ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592024-11-13T20:40:33.941ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d4e011e5-fef3-4800-b7bf-7c88d30de48d, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6602024-11-13T20:40:33.941ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d4e011e5-fef3-4800-b7bf-7c88d30de48d, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612024-11-13T20:40:33.973ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a56b6300-0795-4c14-8877-adb08dfee79b, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6622024-11-13T20:40:33.973ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a56b6300-0795-4c14-8877-adb08dfee79b, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632024-11-13T20:40:34.005ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6642024-11-13T20:40:34.005ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:188
6652024-11-13T20:40:34.005ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:188
6662024-11-13T20:40:34.005ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6672024-11-13T20:40:34.048ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6682024-11-13T20:40:34.048ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6692024-11-13T20:40:34.048ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6702024-11-13T20:40:34.104ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5 file = illumos-utils/src/zone.rs:325
6712024-11-13T20:40:34.108ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d file = illumos-utils/src/zone.rs:325
6722024-11-13T20:40:34.112ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b file = illumos-utils/src/zone.rs:325
6732024-11-13T20:40:34.124ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5 file = illumos-utils/src/zone.rs:363
6742024-11-13T20:40:34.128ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d file = illumos-utils/src/zone.rs:363
6752024-11-13T20:40:34.133ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b file = illumos-utils/src/zone.rs:363
6762024-11-13T20:40:34.647ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
6772024-11-13T20:40:34.842ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
6782024-11-13T20:40:34.842ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
6792024-11-13T20:40:35.053ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/nexus.rs:527 sled_id = b6e177bd-5357-4f01-b047-206109321c43
6802024-11-13T20:40:35.702ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812024-11-13T20:40:35.702ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6822024-11-13T20:40:35.703ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5
6832024-11-13T20:40:36.190ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842024-11-13T20:40:36.672ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6852024-11-13T20:40:36.672ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6862024-11-13T20:40:36.672ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6872024-11-13T20:40:36.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5") failed: Property not found. retry in 65.458056ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5
6882024-11-13T20:40:36.681ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
6892024-11-13T20:40:36.685ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
6902024-11-13T20:40:36.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5") failed: Property not found. retry in 57.386493ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5
6912024-11-13T20:40:36.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d") failed: Property not found. retry in 65.155891ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
6922024-11-13T20:40:36.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b") failed: Property not found. retry in 74.414994ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
6932024-11-13T20:40:36.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5") failed: Property not found. retry in 179.026361ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5
6942024-11-13T20:40:36.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d") failed: Property not found. retry in 94.135329ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
6952024-11-13T20:40:37.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b") failed: Property not found. retry in 89.825064ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
6962024-11-13T20:40:37.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5") failed: Property not found. retry in 315.004682ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5
6972024-11-13T20:40:37.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d") failed: Property not found. retry in 257.972934ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
6982024-11-13T20:40:37.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b") failed: Property not found. retry in 112.73672ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
6992024-11-13T20:40:37.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b") failed: Property not found. retry in 387.223726ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
7002024-11-13T20:40:37.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d") failed: Property not found. retry in 589.865023ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
7012024-11-13T20:40:37.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5") failed: Property not found. retry in 1.177053436s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5
7022024-11-13T20:40:37.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b") failed: Property not found. retry in 1.064505818s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
7032024-11-13T20:40:38.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d") failed: Property not found. retry in 577.220308ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
7042024-11-13T20:40:38.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d") failed: Property not found. retry in 1.274347696s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
7052024-11-13T20:40:38.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5") failed: Property not found. retry in 1.051267749s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5
7062024-11-13T20:40:38.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b") failed: Property not found. retry in 862.617983ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
7072024-11-13T20:40:39.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5") failed: Property not found. retry in 1.430212801s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5
7082024-11-13T20:40:39.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b") failed: Property not found. retry in 558.588681ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
7092024-11-13T20:40:39.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d") failed: Property not found. retry in 507.94152ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
7102024-11-13T20:40:40.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b") failed: Property not found. retry in 668.237367ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
7112024-11-13T20:40:40.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d") failed: Property not found. retry in 1.136831251s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
7122024-11-13T20:40:40.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b") failed: Property not found. retry in 566.220051ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
7132024-11-13T20:40:41.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5") failed: Property not found. retry in 949.280689ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5
7142024-11-13T20:40:41.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b") failed: Property not found. retry in 1.389154825s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
7152024-11-13T20:40:41.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d") failed: Property not found. retry in 665.405425ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
7162024-11-13T20:40:42.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d") failed: Property not found. retry in 1.097106374s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
7172024-11-13T20:40:42.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b") failed: Property not found. retry in 556.078899ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
7182024-11-13T20:40:43.387ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16888347489167188368 sled_id = b6e177bd-5357-4f01-b047-206109321c43
7192024-11-13T20:40:43.387ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 209156185978600993 sled_id = b6e177bd-5357-4f01-b047-206109321c43
7202024-11-13T20:40:43.481ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5
7212024-11-13T20:40:43.481ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_d4e011e5-fef3-4800-b7bf-7c88d30de48d
7222024-11-13T20:40:43.481ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_a56b6300-0795-4c14-8877-adb08dfee79b
7232024-11-13T20:40:43.482ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7242024-11-13T20:40:43.482ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7252024-11-13T20:40:43.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9572946 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54307 req_id = 37810697-70fb-4125-b455-2bfce7cd9c2e response_code = 204 uri = /omicron-zones
7262024-11-13T20:40:43.484ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7272024-11-13T20:40:44.762ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 58.036498ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7282024-11-13T20:40:44.821ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 159.536662ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7292024-11-13T20:40:44.844ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
7302024-11-13T20:40:44.845ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
7312024-11-13T20:40:45.062ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7322024-11-13T20:40:45.241ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 89.123728ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7332024-11-13T20:40:45.331ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 157.353012ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7342024-11-13T20:40:45.567ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7352024-11-13T20:40:45.597ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 123.543333ms) dns_config_addr = [fd00:1122:3344:3::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:3::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7362024-11-13T20:40:45.789ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7372024-11-13T20:40:45.789ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7382024-11-13T20:40:45.819ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7392024-11-13T20:40:45.820ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7402024-11-13T20:40:45.820ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7412024-11-13T20:40:45.849ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5 (service), filesystem_pool: Some(ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d4e011e5-fef3-4800-b7bf-7c88d30de48d (service), filesystem_pool: Some(ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a56b6300-0795-4c14-8877-adb08dfee79b (service), filesystem_pool: Some(ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 891fbd41-6af8-4444-8b15-7b4d1ee3ee0e (service), filesystem_pool: Some(ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: e04e00cb-1517-4c5a-9720-e3e9b4043f7e, kind: Service { id: 891fbd41-6af8-4444-8b15-7b4d1ee3ee0e }, name: Name("ntp-891fbd41-6af8-4444-8b15-7b4d1ee3ee0e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 231])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7422024-11-13T20:40:45.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63730
7432024-11-13T20:40:45.849ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7442024-11-13T20:40:45.849ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: InternalDns }, responder: ... }
7452024-11-13T20:40:45.893ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d4e011e5-fef3-4800-b7bf-7c88d30de48d, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7462024-11-13T20:40:45.893ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d4e011e5-fef3-4800-b7bf-7c88d30de48d, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: InternalDns }, responder: ... }
7472024-11-13T20:40:45.954ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a56b6300-0795-4c14-8877-adb08dfee79b, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7482024-11-13T20:40:45.954ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a56b6300-0795-4c14-8877-adb08dfee79b, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: InternalDns }, responder: ... }
7492024-11-13T20:40:45.990ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7502024-11-13T20:40:45.990ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:177
7512024-11-13T20:40:45.990ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:177
7522024-11-13T20:40:45.990ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7532024-11-13T20:40:46.001ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7542024-11-13T20:40:46.034ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7552024-11-13T20:40:46.034ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7562024-11-13T20:40:46.034ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7572024-11-13T20:40:46.063ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 128, 231]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7582024-11-13T20:40:46.064ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7592024-11-13T20:40:46.064ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7602024-11-13T20:40:46.064ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7612024-11-13T20:40:46.064ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7622024-11-13T20:40:46.065ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7632024-11-13T20:40:46.091ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e file = illumos-utils/src/zone.rs:325
7642024-11-13T20:40:46.109ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e file = illumos-utils/src/zone.rs:363
7652024-11-13T20:40:46.714ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7662024-11-13T20:40:46.714ZINFOSledAgent (ServiceManager): Booting oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7672024-11-13T20:40:46.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e") failed: Property not found. retry in 37.814268ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7682024-11-13T20:40:46.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e") failed: Property not found. retry in 145.263671ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7692024-11-13T20:40:47.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e") failed: Property not found. retry in 263.695299ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7702024-11-13T20:40:47.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e") failed: Property not found. retry in 296.029911ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7712024-11-13T20:40:47.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e") failed: Property not found. retry in 787.788748ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7722024-11-13T20:40:48.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e") failed: Property not found. retry in 1.165232202s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7732024-11-13T20:40:49.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e") failed: Property not found. retry in 1.314888303s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7742024-11-13T20:40:50.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e") failed: Property not found. retry in 792.332795ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7752024-11-13T20:40:51.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e") failed: Property not found. retry in 576.571327ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7762024-11-13T20:40:52.124ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10303406682527339851 sled_id = b6e177bd-5357-4f01-b047-206109321c43
7772024-11-13T20:40:52.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e") failed: Property not found. retry in 1.328249759s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7782024-11-13T20:40:53.337ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12528455707770555180 sled_id = b6e177bd-5357-4f01-b047-206109321c43
7792024-11-13T20:40:53.389ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16888347489167188368 sled_id = b6e177bd-5357-4f01-b047-206109321c43
7802024-11-13T20:40:53.390ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 209156185978600993 sled_id = b6e177bd-5357-4f01-b047-206109321c43
7812024-11-13T20:40:53.483ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9668001266646309265 sled_id = b6e177bd-5357-4f01-b047-206109321c43
7822024-11-13T20:40:53.657ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e
7832024-11-13T20:40:53.657ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7842024-11-13T20:40:53.658ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7852024-11-13T20:40:53.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7809206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:63730 req_id = 54f4d017-1fde-4612-9992-61e5432b44df response_code = 204 uri = /omicron-zones
7862024-11-13T20:40:53.661ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7872024-11-13T20:40:53.690ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7882024-11-13T20:40:53.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59774
7892024-11-13T20:40:53.700ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7902024-11-13T20:40:53.700ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 9433 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59774 req_id = 8fde87c0-3ae1-43c7-a3c5-9e205712f66b response_code = 500 uri = /timesync
7912024-11-13T20:40:53.702ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7922024-11-13T20:40:53.802ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7932024-11-13T20:40:53.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45282
7942024-11-13T20:40:54.847ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
7952024-11-13T20:40:54.847ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
7962024-11-13T20:40:57.810ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7972024-11-13T20:40:57.810ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008011 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45282 req_id = ce892b3b-ce64-44d1-b2a3-60d4e94bc662 response_code = 500 uri = /timesync
7982024-11-13T20:40:57.812ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7992024-11-13T20:40:58.007ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8002024-11-13T20:40:58.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63009
8012024-11-13T20:40:58.016ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8022024-11-13T20:40:58.016ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 9548 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63009 req_id = 1335515a-e8bf-4b7d-8eba-4e99a475567a response_code = 500 uri = /timesync
8032024-11-13T20:40:58.019ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8042024-11-13T20:40:58.181ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8052024-11-13T20:40:58.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63792
8062024-11-13T20:41:01.226ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 239.753788ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8072024-11-13T20:41:02.065ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10303406682527339851 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8082024-11-13T20:41:02.129ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_891fbd41-6af8-4444-8b15-7b4d1ee3ee0e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8092024-11-13T20:41:02.130ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4009264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63792 req_id = d2753ee7-db0a-472a-81ea-5eea0c786033 response_code = 500 uri = /timesync
8102024-11-13T20:41:02.131ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8112024-11-13T20:41:02.336ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8122024-11-13T20:41:02.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53387
8132024-11-13T20:41:02.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8446 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53387 req_id = f17cb0bd-42e6-41d5-9691-2459666ae9d9 response_code = 200 uri = /timesync
8142024-11-13T20:41:02.347ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731530460.050595, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8152024-11-13T20:41:02.347ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8162024-11-13T20:41:02.526ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8172024-11-13T20:41:02.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60278
8182024-11-13T20:41:02.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9013 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60278 req_id = de0f6648-6814-4280-8da9-cfabe793098b response_code = 200 uri = /timesync
8192024-11-13T20:41:02.538ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731530460.050595, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:740
8202024-11-13T20:41:02.538ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8212024-11-13T20:41:03.064ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52173
8222024-11-13T20:41:03.065ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52173 req_id = 619184e0-e481-406e-baae-d39ad5982141 response_code = 200 uri = /baseboard
8232024-11-13T20:41:03.228ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8242024-11-13T20:41:03.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34686
8252024-11-13T20:41:03.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8793 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34686 req_id = a2aff861-d9f9-415a-8a7d-1ec844ee75ae response_code = 200 uri = /timesync
8262024-11-13T20:41:03.239ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731530460.050595, correction: -0.488787442 } file = sled-agent/src/rack_setup/service.rs:740
8272024-11-13T20:41:03.239ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8282024-11-13T20:41:03.608ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8292024-11-13T20:41:03.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35560
8302024-11-13T20:41:03.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8649 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35560 req_id = ff7dc1f0-dfae-42a1-b1a2-eed9ac5503a7 response_code = 200 uri = /timesync
8312024-11-13T20:41:03.619ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731530460.050595, correction: -0.487755597 } file = sled-agent/src/rack_setup/service.rs:740
8322024-11-13T20:41:03.619ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8332024-11-13T20:41:03.635ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12528455707770555180 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8342024-11-13T20:41:03.687ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16888347489167188368 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8352024-11-13T20:41:03.687ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 209156185978600993 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8362024-11-13T20:41:03.780ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9668001266646309265 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8372024-11-13T20:41:03.956ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10887895645096361941 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8382024-11-13T20:41:03.957ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14936099325712236541 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8392024-11-13T20:41:04.119ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8402024-11-13T20:41:04.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34400
8412024-11-13T20:41:04.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8471 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34400 req_id = 73d1516e-6e5a-4c6d-8235-d1b3f6ea1f4d response_code = 200 uri = /timesync
8422024-11-13T20:41:04.131ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731530460.050595, correction: -0.498729825 } file = sled-agent/src/rack_setup/service.rs:740
8432024-11-13T20:41:04.131ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8442024-11-13T20:41:04.726ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8452024-11-13T20:41:04.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46463
8462024-11-13T20:41:04.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8840 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46463 req_id = d4df83ed-cd4b-4f83-8a46-9d41cb764117 response_code = 200 uri = /timesync
8472024-11-13T20:41:04.738ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731530460.050595, correction: -0.49707818 } file = sled-agent/src/rack_setup/service.rs:740
8482024-11-13T20:41:04.738ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8492024-11-13T20:41:05.038ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8502024-11-13T20:41:05.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63986
8512024-11-13T20:41:05.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63986 req_id = 70283c8d-7cd7-454d-ab24-3d1eb75973ef response_code = 200 uri = /timesync
8522024-11-13T20:41:05.051ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731530460.050595, correction: -0.490805507 } file = sled-agent/src/rack_setup/service.rs:740
8532024-11-13T20:41:05.051ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8542024-11-13T20:41:05.143ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8552024-11-13T20:41:05.143ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8562024-11-13T20:41:05.563ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8572024-11-13T20:41:05.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44681
8582024-11-13T20:41:05.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8749 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44681 req_id = 151e2ca8-e533-4370-aae7-6823cdc54ed8 response_code = 200 uri = /timesync
8592024-11-13T20:41:05.574ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731530460.050595, correction: -0.486147165 } file = sled-agent/src/rack_setup/service.rs:740
8602024-11-13T20:41:05.574ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8612024-11-13T20:41:06.250ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8622024-11-13T20:41:06.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38377
8632024-11-13T20:41:06.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9037 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38377 req_id = 2cc65e47-7270-4bcc-b798-a951e1f0f26d response_code = 200 uri = /timesync
8642024-11-13T20:41:06.262ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731530460.050595, correction: -0.484278888 } file = sled-agent/src/rack_setup/service.rs:740
8652024-11-13T20:41:06.262ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8662024-11-13T20:41:07.117ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8672024-11-13T20:41:07.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58918
8682024-11-13T20:41:07.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58918 req_id = bf99aa4f-1446-4a14-955b-1f96209f5fbd response_code = 200 uri = /timesync
8692024-11-13T20:41:07.129ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731530460.050595, correction: -0.483364254 } file = sled-agent/src/rack_setup/service.rs:740
8702024-11-13T20:41:07.129ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8712024-11-13T20:41:08.476ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8722024-11-13T20:41:08.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62633
8732024-11-13T20:41:08.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8532 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62633 req_id = 00b4f8a8-eef7-4cf2-8270-d9c34f6860b1 response_code = 200 uri = /timesync
8742024-11-13T20:41:08.488ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530467.646989, correction: -0.479300737 } file = sled-agent/src/rack_setup/service.rs:740
8752024-11-13T20:41:08.488ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8762024-11-13T20:41:09.240ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8772024-11-13T20:41:09.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33411
8782024-11-13T20:41:09.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33411 req_id = 57b7e7a8-51ef-4016-979d-0758752b9c18 response_code = 200 uri = /timesync
8792024-11-13T20:41:09.252ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530467.646989, correction: -0.477224946 } file = sled-agent/src/rack_setup/service.rs:740
8802024-11-13T20:41:09.252ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8812024-11-13T20:41:10.907ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8822024-11-13T20:41:10.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34586
8832024-11-13T20:41:10.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8736 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34586 req_id = 073433ef-98f3-4a46-87cb-8de124fa7501 response_code = 200 uri = /timesync
8842024-11-13T20:41:10.919ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530469.0692067, correction: -0.472073793 } file = sled-agent/src/rack_setup/service.rs:740
8852024-11-13T20:41:10.919ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8862024-11-13T20:41:12.366ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8872024-11-13T20:41:12.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37967
8882024-11-13T20:41:12.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8837 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37967 req_id = 0cf09c55-2794-4576-a8bd-dd29571fc784 response_code = 200 uri = /timesync
8892024-11-13T20:41:12.377ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530471.1193004, correction: -0.468057901 } file = sled-agent/src/rack_setup/service.rs:740
8902024-11-13T20:41:12.377ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8912024-11-13T20:41:12.401ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10303406682527339851 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8922024-11-13T20:41:13.612ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12528455707770555180 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8932024-11-13T20:41:13.662ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16888347489167188368 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8942024-11-13T20:41:13.662ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 209156185978600993 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8952024-11-13T20:41:13.755ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9668001266646309265 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8962024-11-13T20:41:13.929ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10887895645096361941 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8972024-11-13T20:41:13.930ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14936099325712236541 sled_id = b6e177bd-5357-4f01-b047-206109321c43
8982024-11-13T20:41:14.273ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8992024-11-13T20:41:14.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62289
9002024-11-13T20:41:14.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62289 req_id = 9021fcbe-7e1b-4b11-adc7-d388d604325f response_code = 200 uri = /timesync
9012024-11-13T20:41:14.286ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530472.816993, correction: -0.462809384 } file = sled-agent/src/rack_setup/service.rs:740
9022024-11-13T20:41:14.286ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9032024-11-13T20:41:15.119ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9042024-11-13T20:41:15.119ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9052024-11-13T20:41:16.777ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9062024-11-13T20:41:16.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62655
9072024-11-13T20:41:16.784ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 715.57475ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9082024-11-13T20:41:16.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9081 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62655 req_id = 18382c9b-ba31-4824-9a97-17c84da6be6c response_code = 200 uri = /timesync
9092024-11-13T20:41:16.789ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530475.1377056, correction: -0.456123024 } file = sled-agent/src/rack_setup/service.rs:740
9102024-11-13T20:41:16.789ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9112024-11-13T20:41:19.562ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9122024-11-13T20:41:19.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53691
9132024-11-13T20:41:19.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53691 req_id = 643eb2a6-8609-4501-950d-a283c8d9838b response_code = 200 uri = /timesync
9142024-11-13T20:41:19.575ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530478.4659123, correction: -0.448621273 } file = sled-agent/src/rack_setup/service.rs:740
9152024-11-13T20:41:19.575ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9162024-11-13T20:41:22.376ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10303406682527339851 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9172024-11-13T20:41:23.586ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12528455707770555180 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9182024-11-13T20:41:23.636ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16888347489167188368 reason = Duration(60s) sled_id = b6e177bd-5357-4f01-b047-206109321c43
9192024-11-13T20:41:23.637ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 209156185978600993 reason = Duration(60s) sled_id = b6e177bd-5357-4f01-b047-206109321c43
9202024-11-13T20:41:23.729ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9668001266646309265 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9212024-11-13T20:41:23.823ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9222024-11-13T20:41:23.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32990
9232024-11-13T20:41:23.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8882 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32990 req_id = 033d85bb-3c4e-4663-98cb-55c32aaa5fd6 response_code = 200 uri = /timesync
9242024-11-13T20:41:23.835ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530482.587309, correction: -0.436911464 } file = sled-agent/src/rack_setup/service.rs:740
9252024-11-13T20:41:23.835ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9262024-11-13T20:41:23.904ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10887895645096361941 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9272024-11-13T20:41:23.905ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14936099325712236541 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9282024-11-13T20:41:25.095ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9292024-11-13T20:41:25.095ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9302024-11-13T20:41:26.699ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9312024-11-13T20:41:26.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60301
9322024-11-13T20:41:26.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8911 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60301 req_id = 5df6e768-9d4c-4a36-9eec-c0bbcbb92221 response_code = 200 uri = /timesync
9332024-11-13T20:41:26.711ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530485.4250183, correction: -0.429046035 } file = sled-agent/src/rack_setup/service.rs:740
9342024-11-13T20:41:26.711ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9352024-11-13T20:41:32.282ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9362024-11-13T20:41:32.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33194
9372024-11-13T20:41:32.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8884 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33194 req_id = b2e9825e-32ce-48d5-b2a9-7b3c36dc5b46 response_code = 200 uri = /timesync
9382024-11-13T20:41:32.296ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530490.2148886, correction: -0.413909048 } file = sled-agent/src/rack_setup/service.rs:740
9392024-11-13T20:41:32.296ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9402024-11-13T20:41:32.352ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10303406682527339851 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9412024-11-13T20:41:32.491ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.281459259s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9422024-11-13T20:41:33.021ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59103
9432024-11-13T20:41:33.021ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59103 req_id = 376a6d14-da83-42c9-92ba-6dcbe0de4409 response_code = 200 uri = /baseboard
9442024-11-13T20:41:33.561ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12528455707770555180 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9452024-11-13T20:41:33.703ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9668001266646309265 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9462024-11-13T20:41:33.878ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10887895645096361941 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9472024-11-13T20:41:33.878ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14936099325712236541 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9482024-11-13T20:41:35.070ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9492024-11-13T20:41:35.070ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9502024-11-13T20:41:35.926ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9512024-11-13T20:41:35.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49926
9522024-11-13T20:41:35.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49926 req_id = f9674aab-cfee-46f4-91e7-f205a26c5822 response_code = 200 uri = /timesync
9532024-11-13T20:41:35.938ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530494.7344253, correction: -0.403969258 } file = sled-agent/src/rack_setup/service.rs:740
9542024-11-13T20:41:35.938ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9552024-11-13T20:41:42.328ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 10303406682527339851 reason = Duration(60s) sled_id = b6e177bd-5357-4f01-b047-206109321c43
9562024-11-13T20:41:43.536ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12528455707770555180 reason = Duration(60s) sled_id = b6e177bd-5357-4f01-b047-206109321c43
9572024-11-13T20:41:43.677ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 9668001266646309265 reason = Duration(60s) sled_id = b6e177bd-5357-4f01-b047-206109321c43
9582024-11-13T20:41:43.853ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10887895645096361941 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9592024-11-13T20:41:43.853ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14936099325712236541 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9602024-11-13T20:41:45.045ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9612024-11-13T20:41:45.045ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9622024-11-13T20:41:46.087ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9632024-11-13T20:41:46.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45766
9642024-11-13T20:41:46.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9753 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45766 req_id = 8937c0cb-0d50-4f03-a952-cf7954a9cb71 response_code = 200 uri = /timesync
9652024-11-13T20:41:46.099ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530502.8284402, correction: -0.376403838 } file = sled-agent/src/rack_setup/service.rs:740
9662024-11-13T20:41:46.099ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9672024-11-13T20:41:48.763ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.074531472s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9682024-11-13T20:41:53.827ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 10887895645096361941 reason = Duration(60s) sled_id = b6e177bd-5357-4f01-b047-206109321c43
9692024-11-13T20:41:53.827ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14936099325712236541 reason = Duration(60s) sled_id = b6e177bd-5357-4f01-b047-206109321c43
9702024-11-13T20:41:55.020ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9712024-11-13T20:41:55.020ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9722024-11-13T20:41:55.397ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9732024-11-13T20:41:55.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36750
9742024-11-13T20:41:55.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9606 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36750 req_id = 8d1cd4f5-e249-4386-a8b5-f1cf3816f117 response_code = 200 uri = /timesync
9752024-11-13T20:41:55.411ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530511.4745972, correction: -0.351124763 } file = sled-agent/src/rack_setup/service.rs:740
9762024-11-13T20:41:55.411ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9772024-11-13T20:42:02.973ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60263
9782024-11-13T20:42:02.973ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60263 req_id = 7aedf2c6-2d6a-4bf6-a293-b521049bd5a0 response_code = 200 uri = /baseboard
9792024-11-13T20:42:04.829ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.155593634s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9802024-11-13T20:42:04.995ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9812024-11-13T20:42:04.995ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9822024-11-13T20:42:11.193ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9832024-11-13T20:42:11.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56921
9842024-11-13T20:42:11.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9008 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56921 req_id = 7a630cc4-7c9c-4da1-b26f-0e663f856df1 response_code = 200 uri = /timesync
9852024-11-13T20:42:11.204ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530527.5080662, correction: -0.308284491 } file = sled-agent/src/rack_setup/service.rs:740
9862024-11-13T20:42:11.204ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9872024-11-13T20:42:14.970ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9882024-11-13T20:42:14.970ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9892024-11-13T20:42:23.968ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.457942377s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9902024-11-13T20:42:24.945ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9912024-11-13T20:42:24.945ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
9922024-11-13T20:42:26.709ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9932024-11-13T20:42:26.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35746
9942024-11-13T20:42:26.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8815 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35746 req_id = c10f8afe-5526-4141-9a87-10a86603ea89 response_code = 200 uri = /timesync
9952024-11-13T20:42:26.720ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530543.625383, correction: -0.266248196 } file = sled-agent/src/rack_setup/service.rs:740
9962024-11-13T20:42:26.720ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9972024-11-13T20:42:32.926ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50026
9982024-11-13T20:42:32.926ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50026 req_id = 08490d74-8024-434d-b42e-0516743f1776 response_code = 200 uri = /baseboard
9992024-11-13T20:42:34.920ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10002024-11-13T20:42:34.920ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10012024-11-13T20:42:40.550ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10022024-11-13T20:42:40.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62951
10032024-11-13T20:42:40.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9629 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62951 req_id = b8adddd8-0246-4396-87a4-370b4f219d86 response_code = 200 uri = /timesync
10042024-11-13T20:42:40.563ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530560.2135825, correction: -0.228707239 } file = sled-agent/src/rack_setup/service.rs:740
10052024-11-13T20:42:40.563ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10062024-11-13T20:42:44.895ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10072024-11-13T20:42:44.895ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10082024-11-13T20:42:48.396ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 15.401532857s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10092024-11-13T20:42:54.869ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10102024-11-13T20:42:54.869ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10112024-11-13T20:43:02.880ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35721
10122024-11-13T20:43:02.880ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35721 req_id = 3ca0b116-3b8d-45a6-a1c4-d46cc2228ac4 response_code = 200 uri = /baseboard
10132024-11-13T20:43:04.844ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10142024-11-13T20:43:04.844ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10152024-11-13T20:43:09.021ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10162024-11-13T20:43:09.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59809
10172024-11-13T20:43:09.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59809 req_id = 756e8805-f5c5-401a-8296-d96a421f34ed response_code = 200 uri = /timesync
10182024-11-13T20:43:09.035ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530583.9997418, correction: -0.151449561 } file = sled-agent/src/rack_setup/service.rs:740
10192024-11-13T20:43:09.035ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10202024-11-13T20:43:14.820ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10212024-11-13T20:43:14.820ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10222024-11-13T20:43:18.750ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 44.781731519s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10232024-11-13T20:43:21.177ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10242024-11-13T20:43:21.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56703
10252024-11-13T20:43:21.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9065 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56703 req_id = 81340cbe-a66f-4ba2-801e-7c12a1b9e5dc response_code = 200 uri = /timesync
10262024-11-13T20:43:21.190ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530599.892271, correction: -0.118406579 } file = sled-agent/src/rack_setup/service.rs:740
10272024-11-13T20:43:21.190ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10282024-11-13T20:43:24.795ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10292024-11-13T20:43:24.795ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10302024-11-13T20:43:32.833ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56589
10312024-11-13T20:43:32.833ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56589 req_id = 5e7079b4-15a6-4345-af39-ef735328e75a response_code = 200 uri = /baseboard
10322024-11-13T20:43:34.769ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10332024-11-13T20:43:34.769ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10342024-11-13T20:43:40.171ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10352024-11-13T20:43:40.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40530
10362024-11-13T20:43:40.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8726 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40530 req_id = 0bab1e4b-7dbd-4840-9885-c0114f33892f response_code = 200 uri = /timesync
10372024-11-13T20:43:40.183ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530616.586492, correction: -0.06681893 } file = sled-agent/src/rack_setup/service.rs:740
10382024-11-13T20:43:40.183ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10392024-11-13T20:43:44.744ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10402024-11-13T20:43:44.744ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10412024-11-13T20:43:54.720ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1630812239169100965 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10422024-11-13T20:43:54.720ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3042708854498901416 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10432024-11-13T20:44:02.790ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41063
10442024-11-13T20:44:02.790ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41063 req_id = 9076cc69-d79e-4ce4-a0c5-3cb57cca0f6d response_code = 200 uri = /baseboard
10452024-11-13T20:44:03.475ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10462024-11-13T20:44:03.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54627
10472024-11-13T20:44:03.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 22398 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54627 req_id = f23b5ee6-1d30-45ba-9f0c-f086c3020188 response_code = 200 uri = /timesync
10482024-11-13T20:44:03.498ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-13T20:41:23.636310992Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16888347489167188368 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10492024-11-13T20:44:03.499ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-13T20:41:43.677934104Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 9668001266646309265 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10502024-11-13T20:44:03.500ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-13T20:41:53.827628870Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 10887895645096361941 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10512024-11-13T20:44:03.500ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-13T20:41:23.637142026Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 209156185978600993 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10522024-11-13T20:44:03.500ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-13T20:41:53.827906875Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14936099325712236541 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10532024-11-13T20:44:03.500ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-13T20:41:42.328075601Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 10303406682527339851 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10542024-11-13T20:44:03.501ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-13T20:41:43.536814233Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12528455707770555180 sled_id = b6e177bd-5357-4f01-b047-206109321c43
10552024-11-13T20:44:03.504ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1731530641.371885, correction: -0.005413845 } file = sled-agent/src/rack_setup/service.rs:740
10562024-11-13T20:44:03.504ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1423
10572024-11-13T20:44:03.534ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5 (service), filesystem_pool: Some(ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d4e011e5-fef3-4800-b7bf-7c88d30de48d (service), filesystem_pool: Some(ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a56b6300-0795-4c14-8877-adb08dfee79b (service), filesystem_pool: Some(ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 891fbd41-6af8-4444-8b15-7b4d1ee3ee0e (service), filesystem_pool: Some(ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: e04e00cb-1517-4c5a-9720-e3e9b4043f7e, kind: Service { id: 891fbd41-6af8-4444-8b15-7b4d1ee3ee0e }, name: Name("ntp-891fbd41-6af8-4444-8b15-7b4d1ee3ee0e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 231])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 8975b78f-de16-4148-b76b-777f62cbd076 (service), filesystem_pool: Some(ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External } } } }, OmicronZoneConfig { id: 8afccb2f-481e-47f0-a8b5-8c753c34a848 (service), filesystem_pool: Some(ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External } } } }, OmicronZoneConfig { id: 0b8865e3-f3af-44d7-bd30-628184b78cbf (service), filesystem_pool: Some(ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External } } } }, OmicronZoneConfig { id: 4a1f7b7d-2622-4a93-8814-cc360c9d1101 (service), filesystem_pool: Some(ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6c710443-53d7-4f33-998c-9cf22d116c8e (service), filesystem_pool: Some(ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10582024-11-13T20:44:03.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45974
10592024-11-13T20:44:03.535ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10602024-11-13T20:44:03.535ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: InternalDns }, responder: ... }
10612024-11-13T20:44:03.575ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d4e011e5-fef3-4800-b7bf-7c88d30de48d, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10622024-11-13T20:44:03.576ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d4e011e5-fef3-4800-b7bf-7c88d30de48d, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: InternalDns }, responder: ... }
10632024-11-13T20:44:03.614ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a56b6300-0795-4c14-8877-adb08dfee79b, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10642024-11-13T20:44:03.614ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a56b6300-0795-4c14-8877-adb08dfee79b, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: InternalDns }, responder: ... }
10652024-11-13T20:44:03.646ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8975b78f-de16-4148-b76b-777f62cbd076, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10662024-11-13T20:44:03.646ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8975b78f-de16-4148-b76b-777f62cbd076, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Cockroach }, responder: ... }
10672024-11-13T20:44:03.686ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8afccb2f-481e-47f0-a8b5-8c753c34a848, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10682024-11-13T20:44:03.686ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8afccb2f-481e-47f0-a8b5-8c753c34a848, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10692024-11-13T20:44:03.721ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0b8865e3-f3af-44d7-bd30-628184b78cbf, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10702024-11-13T20:44:03.721ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0b8865e3-f3af-44d7-bd30-628184b78cbf, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10712024-11-13T20:44:03.759ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4a1f7b7d-2622-4a93-8814-cc360c9d1101, dataset_name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10722024-11-13T20:44:03.759ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4a1f7b7d-2622-4a93-8814-cc360c9d1101, dataset_name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10732024-11-13T20:44:03.793ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6c710443-53d7-4f33-998c-9cf22d116c8e, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10742024-11-13T20:44:03.793ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6c710443-53d7-4f33-998c-9cf22d116c8e, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10752024-11-13T20:44:03.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10762024-11-13T20:44:03.832ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:177
10772024-11-13T20:44:03.832ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:177
10782024-11-13T20:44:03.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10792024-11-13T20:44:03.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10802024-11-13T20:44:03.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10812024-11-13T20:44:03.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10822024-11-13T20:44:03.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10832024-11-13T20:44:03.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10842024-11-13T20:44:04.009ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf file = illumos-utils/src/zone.rs:325
10852024-11-13T20:44:04.014ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076 file = illumos-utils/src/zone.rs:325
10862024-11-13T20:44:04.018ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848 file = illumos-utils/src/zone.rs:325
10872024-11-13T20:44:04.022ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101 file = illumos-utils/src/zone.rs:325
10882024-11-13T20:44:04.027ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e file = illumos-utils/src/zone.rs:325
10892024-11-13T20:44:04.031ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf file = illumos-utils/src/zone.rs:363
10902024-11-13T20:44:04.036ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076 file = illumos-utils/src/zone.rs:363
10912024-11-13T20:44:04.042ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848 file = illumos-utils/src/zone.rs:363
10922024-11-13T20:44:04.046ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101 file = illumos-utils/src/zone.rs:363
10932024-11-13T20:44:04.051ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e file = illumos-utils/src/zone.rs:363
10942024-11-13T20:44:06.999ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8975b78f-de16-4148-b76b-777f62cbd076'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10952024-11-13T20:44:07.000ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='6c710443-53d7-4f33-998c-9cf22d116c8e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10962024-11-13T20:44:07.000ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
10972024-11-13T20:44:07.005ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
10982024-11-13T20:44:07.029ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='0b8865e3-f3af-44d7-bd30-628184b78cbf'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10992024-11-13T20:44:07.029ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11002024-11-13T20:44:07.035ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='4a1f7b7d-2622-4a93-8814-cc360c9d1101'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11012024-11-13T20:44:07.035ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11022024-11-13T20:44:07.108ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8afccb2f-481e-47f0-a8b5-8c753c34a848'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11032024-11-13T20:44:07.108ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11042024-11-13T20:44:07.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 54.80692ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11052024-11-13T20:44:07.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 73.811517ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11062024-11-13T20:44:07.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 28.106258ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11072024-11-13T20:44:07.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 30.09106ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11082024-11-13T20:44:07.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 83.756407ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11092024-11-13T20:44:07.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 60.676862ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11102024-11-13T20:44:07.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 100.851185ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11112024-11-13T20:44:07.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 256.978691ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11122024-11-13T20:44:08.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 33.190427ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11132024-11-13T20:44:08.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 279.512402ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11142024-11-13T20:44:08.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 148.615499ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11152024-11-13T20:44:08.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 139.84946ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11162024-11-13T20:44:09.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 267.766039ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11172024-11-13T20:44:09.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 125.287385ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11182024-11-13T20:44:09.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 267.952503ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11192024-11-13T20:44:09.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 232.927379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11202024-11-13T20:44:09.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 518.954626ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11212024-11-13T20:44:09.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 186.622835ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11222024-11-13T20:44:09.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 1.065243413s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11232024-11-13T20:44:09.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 399.847164ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11242024-11-13T20:44:09.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 1.189109166s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11252024-11-13T20:44:09.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 556.46264ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11262024-11-13T20:44:10.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 942.502367ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11272024-11-13T20:44:10.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 929.162502ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11282024-11-13T20:44:10.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 1.163318672s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11292024-11-13T20:44:10.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 901.598939ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11302024-11-13T20:44:10.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 764.440545ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11312024-11-13T20:44:11.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 722.878434ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11322024-11-13T20:44:11.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 858.828574ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11332024-11-13T20:44:11.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 757.147806ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11342024-11-13T20:44:11.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 772.157111ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11352024-11-13T20:44:11.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 560.673164ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11362024-11-13T20:44:11.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 1.114484358s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11372024-11-13T20:44:11.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 693.580538ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11382024-11-13T20:44:12.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 1.410374265s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11392024-11-13T20:44:12.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 1.261652624s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11402024-11-13T20:44:12.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 893.706186ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11412024-11-13T20:44:12.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 1.069448848s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11422024-11-13T20:44:12.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 1.146397742s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11432024-11-13T20:44:13.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 1.324197586s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11442024-11-13T20:44:13.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 820.837481ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11452024-11-13T20:44:13.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 1.357825904s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11462024-11-13T20:44:13.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 749.864169ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11472024-11-13T20:44:14.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 735.113917ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11482024-11-13T20:44:14.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 520.438238ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11492024-11-13T20:44:14.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 1.233173373s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11502024-11-13T20:44:14.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 702.293046ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11512024-11-13T20:44:14.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 849.765073ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11522024-11-13T20:44:14.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 1.237203413s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11532024-11-13T20:44:15.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 879.125801ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11542024-11-13T20:44:15.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 538.93599ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11552024-11-13T20:44:15.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 1.119986457s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11562024-11-13T20:44:15.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 1.094859736s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11572024-11-13T20:44:15.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 1.144351654s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11582024-11-13T20:44:15.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 1.39269195s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11592024-11-13T20:44:16.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 745.433396ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11602024-11-13T20:44:16.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 845.135061ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11612024-11-13T20:44:16.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 901.570604ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11622024-11-13T20:44:16.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 1.108951822s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11632024-11-13T20:44:17.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 1.220219203s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11642024-11-13T20:44:17.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 1.227326266s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11652024-11-13T20:44:17.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101") failed: Property not found. retry in 1.159443869s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11662024-11-13T20:44:17.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 663.598417ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11672024-11-13T20:44:18.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 1.278102039s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11682024-11-13T20:44:18.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076") failed: Property not found. retry in 1.115996652s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11692024-11-13T20:44:18.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 670.654407ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11702024-11-13T20:44:18.443ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 72.432190371s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = b6e177bd-5357-4f01-b047-206109321c43
11712024-11-13T20:44:18.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf") failed: Property not found. retry in 1.044769995s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11722024-11-13T20:44:19.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e") failed: Property not found. retry in 1.498513068s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11732024-11-13T20:44:19.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 877.811194ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11742024-11-13T20:44:20.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 993.700917ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11752024-11-13T20:44:21.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 868.150875ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11762024-11-13T20:44:22.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 948.048863ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11772024-11-13T20:44:23.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 559.067167ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11782024-11-13T20:44:23.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 1.113367097s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11792024-11-13T20:44:25.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 962.135728ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11802024-11-13T20:44:26.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 1.254222922s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11812024-11-13T20:44:27.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 1.050382365s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11822024-11-13T20:44:28.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848") failed: Property not found. retry in 1.347457416s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11832024-11-13T20:44:30.107ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_0b8865e3-f3af-44d7-bd30-628184b78cbf
11842024-11-13T20:44:30.107ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_8975b78f-de16-4148-b76b-777f62cbd076
11852024-11-13T20:44:30.107ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_8afccb2f-481e-47f0-a8b5-8c753c34a848
11862024-11-13T20:44:30.108ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_4a1f7b7d-2622-4a93-8814-cc360c9d1101
11872024-11-13T20:44:30.108ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_6c710443-53d7-4f33-998c-9cf22d116c8e
11882024-11-13T20:44:30.108ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11892024-11-13T20:44:30.112ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11902024-11-13T20:44:30.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 26585306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45974 req_id = ecaf9672-e78f-410f-bc4b-92789c584f2d response_code = 204 uri = /omicron-zones
11912024-11-13T20:44:30.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45536
11922024-11-13T20:44:30.184ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3743
11932024-11-13T20:44:30.384ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11942024-11-13T20:44:34.444ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11952024-11-13T20:44:34.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4295822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:45536 req_id = 86fc4622-fef2-4bbe-95b2-c25d7f73f4aa response_code = 204 uri = /cockroachdb
11962024-11-13T20:44:34.444ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42125
11972024-11-13T20:44:34.445ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42125 req_id = 09dcaa6f-bea4-4ebf-8a22-abc8ab9be895 response_code = 200 uri = /baseboard
11982024-11-13T20:44:34.482ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5 (service), filesystem_pool: Some(ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d4e011e5-fef3-4800-b7bf-7c88d30de48d (service), filesystem_pool: Some(ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a56b6300-0795-4c14-8877-adb08dfee79b (service), filesystem_pool: Some(ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 891fbd41-6af8-4444-8b15-7b4d1ee3ee0e (service), filesystem_pool: Some(ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: e04e00cb-1517-4c5a-9720-e3e9b4043f7e, kind: Service { id: 891fbd41-6af8-4444-8b15-7b4d1ee3ee0e }, name: Name("ntp-891fbd41-6af8-4444-8b15-7b4d1ee3ee0e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 231])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 8975b78f-de16-4148-b76b-777f62cbd076 (service), filesystem_pool: Some(ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External } } } }, OmicronZoneConfig { id: 8afccb2f-481e-47f0-a8b5-8c753c34a848 (service), filesystem_pool: Some(ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External } } } }, OmicronZoneConfig { id: 0b8865e3-f3af-44d7-bd30-628184b78cbf (service), filesystem_pool: Some(ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External } } } }, OmicronZoneConfig { id: 4a1f7b7d-2622-4a93-8814-cc360c9d1101 (service), filesystem_pool: Some(ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6c710443-53d7-4f33-998c-9cf22d116c8e (service), filesystem_pool: Some(ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External } } } }, OmicronZoneConfig { id: a842ec92-0a47-4cf3-961b-d511caae6dde (service), filesystem_pool: Some(ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: a4ccb870-86a7-4151-a1d7-4db6b1a87752, kind: Service { id: a842ec92-0a47-4cf3-961b-d511caae6dde }, name: Name("external-dns-a842ec92-0a47-4cf3-961b-d511caae6dde"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 (service), filesystem_pool: Some(ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 75168899-d87d-49d2-8b98-d14f7b7eb489, kind: Service { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 }, name: Name("external-dns-c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 40a99a76-55e2-4eca-9af8-34234c9027bd (service), filesystem_pool: Some(ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: a710b2c1-2d11-4fa8-853d-ebe0de1435fb, kind: Service { id: 40a99a76-55e2-4eca-9af8-34234c9027bd }, name: Name("nexus-40a99a76-55e2-4eca-9af8-34234c9027bd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc (service), filesystem_pool: Some(ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: cc2e8e88-8497-4746-852d-c6030d315932, kind: Service { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc }, name: Name("nexus-29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee (service), filesystem_pool: Some(ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: dcbb36eb-ec28-4758-b092-0592208645d7, kind: Service { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee }, name: Name("nexus-38f04d99-7fed-47a2-afac-5c2bf6458bee"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 152])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 427aa0d7-82ba-44dc-ad25-9c5f498fd1de (service), filesystem_pool: Some(ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 79dfc5fe-f8fc-4d71-8538-627f7e6bf690 (service), filesystem_pool: Some(ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External } } } }, OmicronZoneConfig { id: d915a471-87fa-40ab-8b59-7ee0612a9a7c (service), filesystem_pool: Some(ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: cac07916-95b6-473d-8fba-c8cfcf7e3629 (service), filesystem_pool: Some(ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 79ac9fe2-f488-45e9-ba49-9003968ea013 (service), filesystem_pool: Some(ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 686e1acb-9675-400d-858f-d3d41f0910b8 (service), filesystem_pool: Some(ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External } } } }, OmicronZoneConfig { id: 15ac7357-6094-4eed-90df-96d45539e934 (service), filesystem_pool: Some(ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External } } } }, OmicronZoneConfig { id: fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e (service), filesystem_pool: Some(ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External } } } }, OmicronZoneConfig { id: f1043e21-d13b-4595-bf8e-75bfc76eb5db (service), filesystem_pool: Some(ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: a7b4c959-dd9c-4391-9a4b-bb666a4b77f3 (service), filesystem_pool: Some(ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External } } } }, OmicronZoneConfig { id: c6223705-7a45-4833-a879-76764209ac90 (service), filesystem_pool: Some(ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External } } } }, OmicronZoneConfig { id: 76e91c18-04af-449f-8351-84fc3acc55af (service), filesystem_pool: Some(ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External } } } }, OmicronZoneConfig { id: c2ac50ba-8e53-41e9-853f-415097d34c97 (service), filesystem_pool: Some(ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7fefb749-d14d-4140-ade1-b01a254b571b (service), filesystem_pool: Some(ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11992024-11-13T20:44:34.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34402
12002024-11-13T20:44:34.483ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12012024-11-13T20:44:34.483ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 350c570e-b0b7-43aa-bd17-cd0ab5ebf3a5, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: InternalDns }, responder: ... }
12022024-11-13T20:44:34.530ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d4e011e5-fef3-4800-b7bf-7c88d30de48d, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12032024-11-13T20:44:34.530ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d4e011e5-fef3-4800-b7bf-7c88d30de48d, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: InternalDns }, responder: ... }
12042024-11-13T20:44:34.580ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a56b6300-0795-4c14-8877-adb08dfee79b, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12052024-11-13T20:44:34.580ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a56b6300-0795-4c14-8877-adb08dfee79b, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: InternalDns }, responder: ... }
12062024-11-13T20:44:34.625ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8975b78f-de16-4148-b76b-777f62cbd076, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12072024-11-13T20:44:34.625ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8975b78f-de16-4148-b76b-777f62cbd076, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Cockroach }, responder: ... }
12082024-11-13T20:44:34.671ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8afccb2f-481e-47f0-a8b5-8c753c34a848, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12092024-11-13T20:44:34.671ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8afccb2f-481e-47f0-a8b5-8c753c34a848, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Cockroach }, responder: ... }
12102024-11-13T20:44:34.713ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0b8865e3-f3af-44d7-bd30-628184b78cbf, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12112024-11-13T20:44:34.713ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0b8865e3-f3af-44d7-bd30-628184b78cbf, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Cockroach }, responder: ... }
12122024-11-13T20:44:34.750ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4a1f7b7d-2622-4a93-8814-cc360c9d1101, dataset_name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12132024-11-13T20:44:34.750ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4a1f7b7d-2622-4a93-8814-cc360c9d1101, dataset_name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12142024-11-13T20:44:34.792ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6c710443-53d7-4f33-998c-9cf22d116c8e, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12152024-11-13T20:44:34.792ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6c710443-53d7-4f33-998c-9cf22d116c8e, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Cockroach }, responder: ... }
12162024-11-13T20:44:34.835ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a842ec92-0a47-4cf3-961b-d511caae6dde, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12172024-11-13T20:44:34.835ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a842ec92-0a47-4cf3-961b-d511caae6dde, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12182024-11-13T20:44:34.882ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12192024-11-13T20:44:34.882ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12202024-11-13T20:44:34.926ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 79dfc5fe-f8fc-4d71-8538-627f7e6bf690, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
12212024-11-13T20:44:34.926ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 79dfc5fe-f8fc-4d71-8538-627f7e6bf690, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12222024-11-13T20:44:34.971ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 686e1acb-9675-400d-858f-d3d41f0910b8, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12232024-11-13T20:44:34.971ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 686e1acb-9675-400d-858f-d3d41f0910b8, dataset_name: DatasetName { pool_name: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, kind: Crucible }, responder: ... }
12242024-11-13T20:44:35.015ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 15ac7357-6094-4eed-90df-96d45539e934, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12252024-11-13T20:44:35.015ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 15ac7357-6094-4eed-90df-96d45539e934, dataset_name: DatasetName { pool_name: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, kind: Crucible }, responder: ... }
12262024-11-13T20:44:35.062ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12272024-11-13T20:44:35.062ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e, dataset_name: DatasetName { pool_name: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, kind: Crucible }, responder: ... }
12282024-11-13T20:44:35.107ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f1043e21-d13b-4595-bf8e-75bfc76eb5db, dataset_name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12292024-11-13T20:44:35.107ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f1043e21-d13b-4595-bf8e-75bfc76eb5db, dataset_name: DatasetName { pool_name: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, kind: Crucible }, responder: ... }
12302024-11-13T20:44:35.148ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a7b4c959-dd9c-4391-9a4b-bb666a4b77f3, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12312024-11-13T20:44:35.148ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a7b4c959-dd9c-4391-9a4b-bb666a4b77f3, dataset_name: DatasetName { pool_name: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, kind: Crucible }, responder: ... }
12322024-11-13T20:44:35.192ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c6223705-7a45-4833-a879-76764209ac90, dataset_name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12332024-11-13T20:44:35.193ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c6223705-7a45-4833-a879-76764209ac90, dataset_name: DatasetName { pool_name: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, kind: Crucible }, responder: ... }
12342024-11-13T20:44:35.238ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 76e91c18-04af-449f-8351-84fc3acc55af, dataset_name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12352024-11-13T20:44:35.238ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 76e91c18-04af-449f-8351-84fc3acc55af, dataset_name: DatasetName { pool_name: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, kind: Crucible }, responder: ... }
12362024-11-13T20:44:35.281ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c2ac50ba-8e53-41e9-853f-415097d34c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12372024-11-13T20:44:35.281ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c2ac50ba-8e53-41e9-853f-415097d34c97, dataset_name: DatasetName { pool_name: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, kind: Crucible }, responder: ... }
12382024-11-13T20:44:35.330ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7fefb749-d14d-4140-ade1-b01a254b571b, dataset_name: DatasetName { pool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12392024-11-13T20:44:35.330ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7fefb749-d14d-4140-ade1-b01a254b571b, dataset_name: DatasetName { pool_name: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, kind: Crucible }, responder: ... }
12402024-11-13T20:44:35.375ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12412024-11-13T20:44:35.375ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:177
12422024-11-13T20:44:35.375ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:177
12432024-11-13T20:44:35.375ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12442024-11-13T20:44:35.480ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12452024-11-13T20:44:35.482ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12462024-11-13T20:44:35.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12472024-11-13T20:44:35.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12482024-11-13T20:44:35.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12492024-11-13T20:44:35.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12502024-11-13T20:44:35.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12512024-11-13T20:44:35.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12522024-11-13T20:44:35.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12532024-11-13T20:44:35.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12542024-11-13T20:44:35.722ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12552024-11-13T20:44:35.759ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12562024-11-13T20:44:35.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12572024-11-13T20:44:35.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12582024-11-13T20:44:35.775ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12592024-11-13T20:44:35.775ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12602024-11-13T20:44:35.799ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12612024-11-13T20:44:35.799ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12622024-11-13T20:44:35.799ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12632024-11-13T20:44:35.800ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de file = illumos-utils/src/zone.rs:325
12642024-11-13T20:44:35.805ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8 file = illumos-utils/src/zone.rs:325
12652024-11-13T20:44:35.810ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c file = illumos-utils/src/zone.rs:325
12662024-11-13T20:44:35.815ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b file = illumos-utils/src/zone.rs:325
12672024-11-13T20:44:35.820ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db file = illumos-utils/src/zone.rs:325
12682024-11-13T20:44:35.826ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3 file = illumos-utils/src/zone.rs:325
12692024-11-13T20:44:35.832ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013 file = illumos-utils/src/zone.rs:325
12702024-11-13T20:44:35.837ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e file = illumos-utils/src/zone.rs:325
12712024-11-13T20:44:35.971ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de file = illumos-utils/src/zone.rs:363
12722024-11-13T20:44:35.976ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8 file = illumos-utils/src/zone.rs:363
12732024-11-13T20:44:35.981ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c file = illumos-utils/src/zone.rs:363
12742024-11-13T20:44:35.986ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b file = illumos-utils/src/zone.rs:363
12752024-11-13T20:44:35.990ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db file = illumos-utils/src/zone.rs:363
12762024-11-13T20:44:35.995ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3 file = illumos-utils/src/zone.rs:363
12772024-11-13T20:44:36.001ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013 file = illumos-utils/src/zone.rs:363
12782024-11-13T20:44:36.006ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e file = illumos-utils/src/zone.rs:363
12792024-11-13T20:44:36.012ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690 file = illumos-utils/src/zone.rs:325
12802024-11-13T20:44:36.017ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934 file = illumos-utils/src/zone.rs:325
12812024-11-13T20:44:36.023ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c6223705-7a45-4833-a879-76764209ac90 file = illumos-utils/src/zone.rs:325
12822024-11-13T20:44:36.030ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629 file = illumos-utils/src/zone.rs:325
12832024-11-13T20:44:36.036ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af file = illumos-utils/src/zone.rs:325
12842024-11-13T20:44:36.042ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97 file = illumos-utils/src/zone.rs:325
12852024-11-13T20:44:36.103ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12862024-11-13T20:44:36.104ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690 file = illumos-utils/src/zone.rs:363
12872024-11-13T20:44:36.113ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934 file = illumos-utils/src/zone.rs:363
12882024-11-13T20:44:36.123ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c6223705-7a45-4833-a879-76764209ac90 file = illumos-utils/src/zone.rs:363
12892024-11-13T20:44:36.132ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629 file = illumos-utils/src/zone.rs:363
12902024-11-13T20:44:36.140ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af file = illumos-utils/src/zone.rs:363
12912024-11-13T20:44:36.147ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97 file = illumos-utils/src/zone.rs:363
12922024-11-13T20:44:36.165ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12932024-11-13T20:44:36.165ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12942024-11-13T20:44:36.227ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 234, 246]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12952024-11-13T20:44:36.227ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12962024-11-13T20:44:36.325ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12972024-11-13T20:44:36.419ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12982024-11-13T20:44:36.481ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12992024-11-13T20:44:36.537ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13002024-11-13T20:44:36.539ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13012024-11-13T20:44:36.539ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13022024-11-13T20:44:36.595ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 226, 152]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13032024-11-13T20:44:36.595ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13042024-11-13T20:44:36.595ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
13052024-11-13T20:44:36.595ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
13062024-11-13T20:44:36.597ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13072024-11-13T20:44:36.597ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13082024-11-13T20:44:36.654ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 245, 73]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13092024-11-13T20:44:36.654ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
13102024-11-13T20:44:36.655ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13112024-11-13T20:44:36.655ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13122024-11-13T20:44:36.709ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 205, 174]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13132024-11-13T20:44:36.709ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13142024-11-13T20:44:36.709ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
13152024-11-13T20:44:36.711ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13162024-11-13T20:44:36.713ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13172024-11-13T20:44:36.713ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13182024-11-13T20:44:36.767ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 186, 133]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13192024-11-13T20:44:36.767ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
13202024-11-13T20:44:36.825ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
13212024-11-13T20:44:36.825ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
13222024-11-13T20:44:36.826ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
13232024-11-13T20:44:36.831ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13242024-11-13T20:44:36.831ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
13252024-11-13T20:44:36.831ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
13262024-11-13T20:44:36.832ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
13272024-11-13T20:44:36.832ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
13282024-11-13T20:44:36.832ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
13292024-11-13T20:44:36.832ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
13302024-11-13T20:44:36.875ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
13312024-11-13T20:44:36.879ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
13322024-11-13T20:44:36.884ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13332024-11-13T20:44:36.884ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13342024-11-13T20:44:36.884ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
13352024-11-13T20:44:36.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13362024-11-13T20:44:36.888ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd file = illumos-utils/src/zone.rs:325
13372024-11-13T20:44:36.899ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee file = illumos-utils/src/zone.rs:325
13382024-11-13T20:44:37.027ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd file = illumos-utils/src/zone.rs:363
13392024-11-13T20:44:37.035ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee file = illumos-utils/src/zone.rs:363
13402024-11-13T20:44:37.042ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde file = illumos-utils/src/zone.rs:325
13412024-11-13T20:44:37.049ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23 file = illumos-utils/src/zone.rs:325
13422024-11-13T20:44:37.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc file = illumos-utils/src/zone.rs:325
13432024-11-13T20:44:37.072ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde file = illumos-utils/src/zone.rs:363
13442024-11-13T20:44:37.083ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23 file = illumos-utils/src/zone.rs:363
13452024-11-13T20:44:37.091ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc file = illumos-utils/src/zone.rs:363
13462024-11-13T20:44:38.081ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2ac620f1-da5f-4a05-8b5c-c70233b71e02'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13472024-11-13T20:44:38.082ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
13482024-11-13T20:44:38.308ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_94d47f77-b938-4683-89de-401156b9868f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9a36d520-31c7-41f3-b21a-84995e390431'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13492024-11-13T20:44:38.353ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
13502024-11-13T20:44:38.492ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='907e41fd-42db-4998-b8e1-e07f1414637a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13512024-11-13T20:44:38.492ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
13522024-11-13T20:44:38.642ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e43f0729-982f-4960-b10a-7966152ae48a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8129107a-55f8-41c5-9a3f-6bcf6e6baf6c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13532024-11-13T20:44:38.678ZINFOSledAgent (ServiceManager): Booting oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
13542024-11-13T20:44:38.685ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_df67e3ea-c363-421d-9d4f-d05175051931/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f2f83544-1944-4e73-82ca-65ceb9eb620e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552024-11-13T20:44:38.685ZINFOSledAgent (ServiceManager): Booting oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
13562024-11-13T20:44:38.827ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f0cb9978-0450-4862-833d-25b9f3f6b188'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13572024-11-13T20:44:38.828ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
13582024-11-13T20:44:38.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 30.541406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
13592024-11-13T20:44:39.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 73.525609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
13602024-11-13T20:44:39.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 46.678275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
13612024-11-13T20:44:39.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 30.50848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
13622024-11-13T20:44:39.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 56.4723ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
13632024-11-13T20:44:39.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 42.802481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
13642024-11-13T20:44:39.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 90.223652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
13652024-11-13T20:44:39.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 115.397404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
13662024-11-13T20:44:39.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 123.638409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
13672024-11-13T20:44:39.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 67.035641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
13682024-11-13T20:44:39.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 109.528681ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
13692024-11-13T20:44:39.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 97.557884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
13702024-11-13T20:44:39.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 203.241624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
13712024-11-13T20:44:45.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 214.829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
13722024-11-13T20:44:45.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 134.777066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
13732024-11-13T20:44:45.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 325.056817ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
13742024-11-13T20:44:45.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 214.40216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
13752024-11-13T20:44:45.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 147.428245ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
13762024-11-13T20:44:45.825ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13772024-11-13T20:44:45.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 283.858499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
13782024-11-13T20:44:45.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 293.361562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
13792024-11-13T20:44:45.864ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
13802024-11-13T20:44:45.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 489.153353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
13812024-11-13T20:44:45.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 299.196723ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
13822024-11-13T20:44:45.995ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='427aa0d7-82ba-44dc-ad25-9c5f498fd1de'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13832024-11-13T20:44:45.995ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
13842024-11-13T20:44:46.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 395.435554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
13852024-11-13T20:44:46.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 578.120358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
13862024-11-13T20:44:46.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 1.073318555s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
13872024-11-13T20:44:46.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 499.955131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
13882024-11-13T20:44:46.217ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_668784d0-9ec9-43d5-800e-a1a6d097030c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fb50a525-7275-4396-8fd3-e109360dce81'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13892024-11-13T20:44:46.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 834.555854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
13902024-11-13T20:44:46.308ZINFOSledAgent (ServiceManager): Booting oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
13912024-11-13T20:44:46.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 949.646187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
13922024-11-13T20:44:46.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 816.5503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
13932024-11-13T20:44:46.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 1.293082903s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
13942024-11-13T20:44:46.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 407.08188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
13952024-11-13T20:44:46.689ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13962024-11-13T20:44:46.689ZINFOSledAgent (ServiceManager): Booting oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
13972024-11-13T20:44:46.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 54.670865ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
13982024-11-13T20:44:46.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 67.611654ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
13992024-11-13T20:44:46.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 72.217139ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
14002024-11-13T20:44:46.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 131.047094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
14012024-11-13T20:44:46.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 27.944038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
14022024-11-13T20:44:46.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 116.03368ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
14032024-11-13T20:44:46.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 72.514539ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
14042024-11-13T20:44:46.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 85.815993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
14052024-11-13T20:44:46.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 250.518564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
14062024-11-13T20:44:47.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 131.177718ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
14072024-11-13T20:44:47.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 117.378879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
14082024-11-13T20:44:47.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 432.60466ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
14092024-11-13T20:44:47.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 1.267755068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
14102024-11-13T20:44:47.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 257.090228ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
14112024-11-13T20:44:47.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 1.293375348s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
14122024-11-13T20:44:47.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 244.781711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
14132024-11-13T20:44:47.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 1.462004053s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
14142024-11-13T20:44:47.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 253.003656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
14152024-11-13T20:44:47.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 1.381846032s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
14162024-11-13T20:44:47.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 739.09318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
14172024-11-13T20:44:47.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 459.514632ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
14182024-11-13T20:44:47.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 508.512131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
14192024-11-13T20:44:47.450ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14202024-11-13T20:44:47.451ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
14212024-11-13T20:44:47.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 910.640156ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
14222024-11-13T20:44:47.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 943.953597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
14232024-11-13T20:44:47.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 34.67807ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
14242024-11-13T20:44:47.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 88.484958ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
14252024-11-13T20:44:47.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 840.958502ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
14262024-11-13T20:44:47.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 287.283838ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
14272024-11-13T20:44:47.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 816.828215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
14282024-11-13T20:44:47.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 1.070129357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
14292024-11-13T20:44:48.023ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14302024-11-13T20:44:48.024ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
14312024-11-13T20:44:48.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 1.250583229s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
14322024-11-13T20:44:48.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 494.065708ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
14332024-11-13T20:44:48.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 573.44966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
14342024-11-13T20:44:48.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 741.94632ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
14352024-11-13T20:44:48.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 1.09212525s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
14362024-11-13T20:44:48.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 916.117197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
14372024-11-13T20:44:48.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 659.619013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
14382024-11-13T20:44:48.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 1.131587444s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
14392024-11-13T20:44:48.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 744.043936ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
14402024-11-13T20:44:48.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 1.472704429s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
14412024-11-13T20:44:48.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 1.374145043s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
14422024-11-13T20:44:48.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 669.30803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
14432024-11-13T20:44:49.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 644.716945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
14442024-11-13T20:44:49.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 1.419129164s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
14452024-11-13T20:44:49.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 1.045118113s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
14462024-11-13T20:44:49.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 931.327724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
14472024-11-13T20:44:49.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 642.591993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
14482024-11-13T20:44:49.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 868.957127ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
14492024-11-13T20:44:49.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 1.434566109s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
14502024-11-13T20:44:49.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 990.032596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
14512024-11-13T20:44:49.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 905.855974ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
14522024-11-13T20:44:49.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 1.100451156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
14532024-11-13T20:44:50.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 671.712988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
14542024-11-13T20:44:50.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 1.262227746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
14552024-11-13T20:44:50.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 1.39646767s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
14562024-11-13T20:44:50.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 1.280426492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
14572024-11-13T20:44:50.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 1.25749376s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
14582024-11-13T20:44:50.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 974.070947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
14592024-11-13T20:44:50.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 1.441512736s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
14602024-11-13T20:44:50.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 754.995721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
14612024-11-13T20:44:50.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 690.870066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
14622024-11-13T20:44:50.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 1.003804337s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
14632024-11-13T20:44:51.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 544.347094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
14642024-11-13T20:44:51.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 705.013294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
14652024-11-13T20:44:51.301ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0308e0f0-1b4c-4b7c-ac5a-728c68eddf17'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14662024-11-13T20:44:51.301ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c6223705-7a45-4833-a879-76764209ac90: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2c90aa03-5691-4147-8289-5741cd7b19ba/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a59031c3-22a4-4d79-acb6-022ff4ede459'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14672024-11-13T20:45:00.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 1.049416463s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
14682024-11-13T20:45:00.701ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c6223705-7a45-4833-a879-76764209ac90 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
14692024-11-13T20:45:00.708ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
14702024-11-13T20:45:00.714ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14712024-11-13T20:45:00.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 1.428539438s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
14722024-11-13T20:45:00.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 1.266438863s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
14732024-11-13T20:45:00.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 772.89642ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
14742024-11-13T20:45:00.806ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14752024-11-13T20:45:00.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 1.425048734s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
14762024-11-13T20:45:00.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 1.117721855s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
14772024-11-13T20:45:00.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 548.494412ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
14782024-11-13T20:45:00.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 903.358282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
14792024-11-13T20:45:00.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 634.459983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
14802024-11-13T20:45:00.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 1.360809394s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
14812024-11-13T20:45:00.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 1.441394746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
14822024-11-13T20:45:00.881ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
14832024-11-13T20:45:00.886ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
14842024-11-13T20:45:00.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 54.180885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
14852024-11-13T20:45:00.900ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14862024-11-13T20:45:00.900ZINFOSledAgent (ServiceManager): Booting oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
14872024-11-13T20:45:00.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 34.469987ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
14882024-11-13T20:45:00.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 72.819422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
14892024-11-13T20:45:00.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 61.769387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
14902024-11-13T20:45:00.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 67.666978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
14912024-11-13T20:45:01.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 118.734668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
14922024-11-13T20:45:01.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 278.042595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
14932024-11-13T20:45:01.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 107.174132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
14942024-11-13T20:45:01.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 35.124302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
14952024-11-13T20:45:01.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 27.120265ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
14962024-11-13T20:45:01.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 70.720182ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
14972024-11-13T20:45:01.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 134.982279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
14982024-11-13T20:45:01.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 64.706084ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
14992024-11-13T20:45:01.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 312.768388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
15002024-11-13T20:45:01.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 261.575954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
15012024-11-13T20:45:01.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 67.614446ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
15022024-11-13T20:45:01.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 182.417042ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
15032024-11-13T20:45:01.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 205.88477ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
15042024-11-13T20:45:01.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 239.860142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
15052024-11-13T20:45:01.317ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15062024-11-13T20:45:01.317ZINFOSledAgent (ServiceManager): Booting oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
15072024-11-13T20:45:01.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 368.482068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
15082024-11-13T20:45:01.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 605.203755ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
15092024-11-13T20:45:01.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 292.028165ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
15102024-11-13T20:45:01.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 295.006918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
15112024-11-13T20:45:01.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 1.386742454s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
15122024-11-13T20:45:01.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 976.397794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
15132024-11-13T20:45:01.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 489.444409ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
15142024-11-13T20:45:01.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 66.386004ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
15152024-11-13T20:45:01.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 250.058368ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
15162024-11-13T20:45:01.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 1.469635098s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
15172024-11-13T20:45:01.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 76.583507ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
15182024-11-13T20:45:01.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 254.315279ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
15192024-11-13T20:45:01.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 712.867903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
15202024-11-13T20:45:01.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 1.157715487s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
15212024-11-13T20:45:01.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 1.086569356s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
15222024-11-13T20:45:01.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 1.20301957s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
15232024-11-13T20:45:01.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 987.773852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
15242024-11-13T20:45:01.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 938.203224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
15252024-11-13T20:45:01.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 818.290524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
15262024-11-13T20:45:02.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 554.886022ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
15272024-11-13T20:45:02.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 964.258016ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
15282024-11-13T20:45:02.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 590.218739ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
15292024-11-13T20:45:02.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 976.056879ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
15302024-11-13T20:45:02.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 1.127820416s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
15312024-11-13T20:45:02.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 1.095897556s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
15322024-11-13T20:45:02.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 581.675811ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
15332024-11-13T20:45:02.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 1.30471772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
15342024-11-13T20:45:02.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 1.369635755s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
15352024-11-13T20:45:02.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 899.527851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
15362024-11-13T20:45:02.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 907.968505ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
15372024-11-13T20:45:02.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 1.324411719s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
15382024-11-13T20:45:02.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 551.411945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
15392024-11-13T20:45:02.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 1.110558935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
15402024-11-13T20:45:02.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 984.140524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
15412024-11-13T20:45:02.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 1.332116151s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
15422024-11-13T20:45:02.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 1.003397115s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
15432024-11-13T20:45:02.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 766.555076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
15442024-11-13T20:45:02.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 958.67621ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
15452024-11-13T20:45:02.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 725.153453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
15462024-11-13T20:45:02.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 771.938666ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
15472024-11-13T20:45:03.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 983.935978ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
15482024-11-13T20:45:03.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 1.284827703s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
15492024-11-13T20:45:03.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 1.0456494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
15502024-11-13T20:45:03.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 654.841826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
15512024-11-13T20:45:03.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 815.34343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
15522024-11-13T20:45:03.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 656.125273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
15532024-11-13T20:45:03.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 1.27554926s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
15542024-11-13T20:45:03.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 764.605329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
15552024-11-13T20:45:03.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 1.005651455s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
15562024-11-13T20:45:03.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 1.29849393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
15572024-11-13T20:45:03.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 549.717089ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
15582024-11-13T20:45:03.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 1.386555574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
15592024-11-13T20:45:03.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 1.321350673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
15602024-11-13T20:45:03.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 1.044803483s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
15612024-11-13T20:45:03.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 1.330773414s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
15622024-11-13T20:45:03.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 752.099146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
15632024-11-13T20:45:03.933ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15642024-11-13T20:45:03.933ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
15652024-11-13T20:45:03.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 1.29955609s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
15662024-11-13T20:45:04.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 1.172051188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
15672024-11-13T20:45:04.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 1.398498266s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
15682024-11-13T20:45:04.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 569.7696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
15692024-11-13T20:45:04.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 1.060127971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
15702024-11-13T20:45:04.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 49.774272ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
15712024-11-13T20:45:04.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 1.405268982s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
15722024-11-13T20:45:04.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 56.1902ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
15732024-11-13T20:45:04.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 210.302936ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
15742024-11-13T20:45:04.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 1.020171893s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
15752024-11-13T20:45:04.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 736.417315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
15762024-11-13T20:45:04.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 521.748656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
15772024-11-13T20:45:04.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 877.874278ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
15782024-11-13T20:45:04.597ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47035
15792024-11-13T20:45:04.599ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 505 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47035 req_id = 94fd4de8-9e6f-4832-b9b5-5d82abc94e5b response_code = 200 uri = /baseboard
15802024-11-13T20:45:04.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 314.247994ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
15812024-11-13T20:45:04.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 956.732771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
15822024-11-13T20:45:04.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 807.452493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
15832024-11-13T20:45:04.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 1.474009521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
15842024-11-13T20:45:04.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 714.171311ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
15852024-11-13T20:45:04.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 1.397910402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
15862024-11-13T20:45:04.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 776.398263ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
15872024-11-13T20:45:05.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 967.251702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
15882024-11-13T20:45:05.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 1.48260537s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
15892024-11-13T20:45:05.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 566.405556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
15902024-11-13T20:45:05.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 1.027410582s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
15912024-11-13T20:45:05.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 783.247866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
15922024-11-13T20:45:05.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 973.133621ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
15932024-11-13T20:45:05.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 751.836115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
15942024-11-13T20:45:05.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 1.227573758s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
15952024-11-13T20:45:05.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 804.020339ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
15962024-11-13T20:45:05.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 1.00393136s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
15972024-11-13T20:45:05.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 1.280502127s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
15982024-11-13T20:45:05.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 1.015526742s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
15992024-11-13T20:45:05.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 888.454057ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
16002024-11-13T20:45:05.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 787.033522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
16012024-11-13T20:45:05.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 1.244406646s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
16022024-11-13T20:45:05.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 1.473901198s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
16032024-11-13T20:45:05.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 1.0320092s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
16042024-11-13T20:45:05.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 900.65254ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
16052024-11-13T20:45:06.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 644.341903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
16062024-11-13T20:45:06.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 1.037701357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
16072024-11-13T20:45:06.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 1.200123962s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
16082024-11-13T20:45:06.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 875.099199ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
16092024-11-13T20:45:06.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 957.11958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
16102024-11-13T20:45:06.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 517.458881ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
16112024-11-13T20:45:06.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 754.13783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
16122024-11-13T20:45:06.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 1.1467721s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
16132024-11-13T20:45:06.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 1.386314621s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
16142024-11-13T20:45:06.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 761.482281ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
16152024-11-13T20:45:06.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 1.452477445s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
16162024-11-13T20:45:06.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 1.374647635s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
16172024-11-13T20:45:06.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 720.91765ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
16182024-11-13T20:45:06.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 594.867099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
16192024-11-13T20:45:06.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 1.310472775s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
16202024-11-13T20:45:06.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 1.210490881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
16212024-11-13T20:45:06.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 944.386945ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
16222024-11-13T20:45:06.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 1.444723257s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
16232024-11-13T20:45:06.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 1.105660319s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
16242024-11-13T20:45:06.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 756.646687ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
16252024-11-13T20:45:07.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 836.660782ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
16262024-11-13T20:45:07.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 1.24056171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
16272024-11-13T20:45:07.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 1.13056161s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
16282024-11-13T20:45:07.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 1.472082842s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
16292024-11-13T20:45:07.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 1.32692167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
16302024-11-13T20:45:07.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 932.356251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
16312024-11-13T20:45:07.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 1.337740536s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
16322024-11-13T20:45:07.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 1.31970453s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
16332024-11-13T20:45:07.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 1.071088872s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
16342024-11-13T20:45:07.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 1.138415596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
16352024-11-13T20:45:07.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 551.411722ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
16362024-11-13T20:45:07.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 855.671818ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
16372024-11-13T20:45:07.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3") failed: Property not found. retry in 1.49566537s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
16382024-11-13T20:45:07.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 1.12810329s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
16392024-11-13T20:45:07.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 667.803803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
16402024-11-13T20:45:07.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 1.442389808s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
16412024-11-13T20:45:07.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 981.483201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
16422024-11-13T20:45:07.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 706.297422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
16432024-11-13T20:45:07.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 807.749927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
16442024-11-13T20:45:08.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 525.416194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
16452024-11-13T20:45:08.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 746.886095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
16462024-11-13T20:45:08.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde") failed: Property not found. retry in 1.076914155s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
16472024-11-13T20:45:08.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc") failed: Property not found. retry in 1.245535649s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
16482024-11-13T20:45:08.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b") failed: Property not found. retry in 1.400730347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
16492024-11-13T20:45:08.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de") failed: Property not found. retry in 1.109048138s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
16502024-11-13T20:45:08.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c") failed: Property not found. retry in 969.606432ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
16512024-11-13T20:45:08.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 993.097387ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
16522024-11-13T20:45:08.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 1.146505136s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
16532024-11-13T20:45:08.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23") failed: Property not found. retry in 911.047988ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
16542024-11-13T20:45:08.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 935.528171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
16552024-11-13T20:45:08.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af") failed: Property not found. retry in 1.071378577s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
16562024-11-13T20:45:08.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 1.223182911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
16572024-11-13T20:45:08.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db") failed: Property not found. retry in 1.161368869s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
16582024-11-13T20:45:08.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934") failed: Property not found. retry in 1.261683333s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
16592024-11-13T20:45:08.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e") failed: Property not found. retry in 988.511738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
16602024-11-13T20:45:08.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 633.863716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
16612024-11-13T20:45:08.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8") failed: Property not found. retry in 1.244029885s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
16622024-11-13T20:45:08.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 1.138640795s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
16632024-11-13T20:45:09.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 786.117553ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
16642024-11-13T20:45:09.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 505.095862ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
16652024-11-13T20:45:09.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 1.239650007s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
16662024-11-13T20:45:09.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 839.943656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
16672024-11-13T20:45:09.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 869.424379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
16682024-11-13T20:45:09.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 995.592579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
16692024-11-13T20:45:10.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 904.262079ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
16702024-11-13T20:45:10.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd") failed: Property not found. retry in 687.006914ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
16712024-11-13T20:45:10.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 695.588663ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
16722024-11-13T20:45:10.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 1.222919048s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
16732024-11-13T20:45:10.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 1.049496182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
16742024-11-13T20:45:10.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 776.136878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
16752024-11-13T20:45:10.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 1.101353881s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
16762024-11-13T20:45:10.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6223705-7a45-4833-a879-76764209ac90") failed: Property not found. retry in 1.294108762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
16772024-11-13T20:45:11.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 1.13706198s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
16782024-11-13T20:45:11.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629") failed: Property not found. retry in 1.4833212s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
16792024-11-13T20:45:11.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013") failed: Property not found. retry in 1.000733579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
16802024-11-13T20:45:11.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97") failed: Property not found. retry in 1.043932171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
16812024-11-13T20:45:12.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 816.480011ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
16822024-11-13T20:45:12.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee") failed: Property not found. retry in 730.749718ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
16832024-11-13T20:45:12.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690") failed: Property not found. retry in 1.487032625s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
16842024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_40a99a76-55e2-4eca-9af8-34234c9027bd
16852024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_38f04d99-7fed-47a2-afac-5c2bf6458bee
16862024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_427aa0d7-82ba-44dc-ad25-9c5f498fd1de
16872024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_686e1acb-9675-400d-858f-d3d41f0910b8
16882024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_d915a471-87fa-40ab-8b59-7ee0612a9a7c
16892024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_7fefb749-d14d-4140-ade1-b01a254b571b
16902024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_f1043e21-d13b-4595-bf8e-75bfc76eb5db
16912024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a7b4c959-dd9c-4391-9a4b-bb666a4b77f3
16922024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_79ac9fe2-f488-45e9-ba49-9003968ea013
16932024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_fbc7279b-43a3-47ca-b1cf-ad7f4b77b82e
16942024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_a842ec92-0a47-4cf3-961b-d511caae6dde
16952024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_79dfc5fe-f8fc-4d71-8538-627f7e6bf690
16962024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_15ac7357-6094-4eed-90df-96d45539e934
16972024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_c0b478f6-c4ff-4a37-9722-a315ddbf3b23
16982024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_c6223705-7a45-4833-a879-76764209ac90
16992024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_29a3fd7c-689d-4453-8c67-7ba6665d3bfc
17002024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_cac07916-95b6-473d-8fba-c8cfcf7e3629
17012024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_76e91c18-04af-449f-8351-84fc3acc55af
17022024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_c2ac50ba-8e53-41e9-853f-415097d34c97
17032024-11-13T20:45:14.396ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17042024-11-13T20:45:14.398ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17052024-11-13T20:45:14.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39921239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34402 req_id = db08d97c-586b-470f-82ab-214713b6abb0 response_code = 204 uri = /omicron-zones
17062024-11-13T20:45:14.416ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1446
17072024-11-13T20:45:14.416ZINFOSledAgent (RSS): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17082024-11-13T20:45:14.416ZINFOSledAgent (RSS): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17092024-11-13T20:45:14.418ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
17102024-11-13T20:45:14.419ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
17112024-11-13T20:45:14.456ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1011
17122024-11-13T20:45:14.464ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/849aa495-6145-49b0-a290-3c6c58cf8497/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17132024-11-13T20:45:14.566ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/849aa495-6145-49b0-a290-3c6c58cf8497/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17142024-11-13T20:45:14.635ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/849aa495-6145-49b0-a290-3c6c58cf8497/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17152024-11-13T20:45:14.740ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/849aa495-6145-49b0-a290-3c6c58cf8497/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17162024-11-13T20:45:14.782ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
17172024-11-13T20:45:14.836ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/849aa495-6145-49b0-a290-3c6c58cf8497/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17182024-11-13T20:45:15.114ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/849aa495-6145-49b0-a290-3c6c58cf8497/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17192024-11-13T20:45:15.307ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/849aa495-6145-49b0-a290-3c6c58cf8497/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17202024-11-13T20:45:15.588ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/849aa495-6145-49b0-a290-3c6c58cf8497/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17212024-11-13T20:45:15.787ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/probe_manager.rs:231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
17222024-11-13T20:45:15.933ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/849aa495-6145-49b0-a290-3c6c58cf8497/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17232024-11-13T20:45:16.183ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/b6e177bd-5357-4f01-b047-206109321c43) file = sled-agent/src/nexus.rs:527 sled_id = b6e177bd-5357-4f01-b047-206109321c43
17242024-11-13T20:45:16.227ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/849aa495-6145-49b0-a290-3c6c58cf8497/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1073
17252024-11-13T20:45:17.075ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d074ba5c-ea7d-44fe-a6fd-adc97b471cb1", "content-length": "173", "date": "Wed, 13 Nov 2024 20:45:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"849aa495-6145-49b0-a290-3c6c58cf8497\"", request_id: "d074ba5c-ea7d-44fe-a6fd-adc97b471cb1" } file = sled-agent/src/rack_setup/service.rs:1073
17262024-11-13T20:45:17.466ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "12672bc3-45b7-40ba-9111-9a9be78e04a9", "content-length": "173", "date": "Wed, 13 Nov 2024 20:45:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"849aa495-6145-49b0-a290-3c6c58cf8497\"", request_id: "12672bc3-45b7-40ba-9111-9a9be78e04a9" } file = sled-agent/src/rack_setup/service.rs:1073
17272024-11-13T20:45:18.358ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f8239782-e324-4ca8-a31e-d0bcfcdfe8f8", "content-length": "173", "date": "Wed, 13 Nov 2024 20:45:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"849aa495-6145-49b0-a290-3c6c58cf8497\"", request_id: "f8239782-e324-4ca8-a31e-d0bcfcdfe8f8" } file = sled-agent/src/rack_setup/service.rs:1073
17282024-11-13T20:45:18.826ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = b6e177bd-5357-4f01-b047-206109321c43
17292024-11-13T20:45:18.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37975
17302024-11-13T20:45:18.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17312024-11-13T20:45:18.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17322024-11-13T20:45:18.982ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:177
17332024-11-13T20:45:18.982ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:177
17342024-11-13T20:45:19.004ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17352024-11-13T20:45:19.004ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_668784d0-9ec9-43d5-800e-a1a6d097030c
17362024-11-13T20:45:19.044ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17372024-11-13T20:45:19.044ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e43f0729-982f-4960-b10a-7966152ae48a
17382024-11-13T20:45:19.080ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17392024-11-13T20:45:19.080ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_94d47f77-b938-4683-89de-401156b9868f
17402024-11-13T20:45:19.114ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17412024-11-13T20:45:19.114ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8
17422024-11-13T20:45:19.145ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17432024-11-13T20:45:19.145ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b
17442024-11-13T20:45:19.176ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17452024-11-13T20:45:19.177ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2c90aa03-5691-4147-8289-5741cd7b19ba
17462024-11-13T20:45:19.208ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17472024-11-13T20:45:19.208ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_df67e3ea-c363-421d-9d4f-d05175051931
17482024-11-13T20:45:19.246ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17492024-11-13T20:45:19.246ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2
17502024-11-13T20:45:19.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44499
17512024-11-13T20:45:19.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 779 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44499 req_id = bf2a610d-b541-4735-842a-daed3d20358b response_code = 200 uri = /vpc-routes
17522024-11-13T20:45:19.294ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17532024-11-13T20:45:19.294ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828
17542024-11-13T20:45:19.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 336210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37975 req_id = 9b272ce5-bdb3-40a3-9894-22aaabb51372 response_code = 200 uri = /inventory
17552024-11-13T20:45:19.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57066
17562024-11-13T20:45:19.338ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17572024-11-13T20:45:19.338ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17582024-11-13T20:45:19.338ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:177
17592024-11-13T20:45:19.338ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:177
17602024-11-13T20:45:19.355ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17612024-11-13T20:45:19.355ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_668784d0-9ec9-43d5-800e-a1a6d097030c
17622024-11-13T20:45:19.390ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17632024-11-13T20:45:19.390ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e43f0729-982f-4960-b10a-7966152ae48a
17642024-11-13T20:45:19.417ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
17652024-11-13T20:45:19.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 706 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44499 req_id = 9fa64258-88af-4ae8-9fb0-db10b7ab1abb response_code = 204 uri = /eip-gateways
17662024-11-13T20:45:19.425ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17672024-11-13T20:45:19.425ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_94d47f77-b938-4683-89de-401156b9868f
17682024-11-13T20:45:19.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54802
17692024-11-13T20:45:19.457ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17702024-11-13T20:45:19.457ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8
17712024-11-13T20:45:19.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4920 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54802 req_id = 9a3be8e8-d787-40e8-8eb5-31b7df5bc6c2 response_code = 200 uri = /v2p
17722024-11-13T20:45:19.486ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17732024-11-13T20:45:19.487ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b
17742024-11-13T20:45:19.510ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17752024-11-13T20:45:19.510ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2c90aa03-5691-4147-8289-5741cd7b19ba
17762024-11-13T20:45:19.539ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17772024-11-13T20:45:19.540ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_df67e3ea-c363-421d-9d4f-d05175051931
17782024-11-13T20:45:19.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2885 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44499 req_id = b34b7b64-4080-4bd5-ba2f-5fd30a5b920a response_code = 204 uri = /vpc-routes
17792024-11-13T20:45:19.565ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17802024-11-13T20:45:19.566ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2
17812024-11-13T20:45:19.594ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17822024-11-13T20:45:19.594ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828
17832024-11-13T20:45:19.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 270576 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57066 req_id = cead07fe-1f5e-45e8-93a9-29d9e102b7f7 response_code = 200 uri = /inventory
17842024-11-13T20:45:19.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44482
17852024-11-13T20:45:19.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44482 req_id = 3929cc03-291e-499e-92cb-213ad985f099 response_code = 200 uri = /vpc-routes
17862024-11-13T20:45:19.800ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
17872024-11-13T20:45:19.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44482 req_id = 39c4bf50-675a-4385-aa66-f7d2407f4798 response_code = 204 uri = /eip-gateways
17882024-11-13T20:45:19.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58718
17892024-11-13T20:45:19.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58718 req_id = 89de6ed9-68f8-4027-aec7-a56875ecb141 response_code = 200 uri = /v2p
17902024-11-13T20:45:19.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51244
17912024-11-13T20:45:19.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17922024-11-13T20:45:19.887ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17932024-11-13T20:45:19.887ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:177
17942024-11-13T20:45:19.888ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:177
17952024-11-13T20:45:19.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1008 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44482 req_id = b941b277-9d74-4138-aad7-51e89a10430c response_code = 204 uri = /vpc-routes
17962024-11-13T20:45:19.900ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17972024-11-13T20:45:19.900ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_668784d0-9ec9-43d5-800e-a1a6d097030c
17982024-11-13T20:45:19.930ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17992024-11-13T20:45:19.930ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e43f0729-982f-4960-b10a-7966152ae48a
18002024-11-13T20:45:19.953ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18012024-11-13T20:45:19.954ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_94d47f77-b938-4683-89de-401156b9868f
18022024-11-13T20:45:19.977ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18032024-11-13T20:45:19.977ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8
18042024-11-13T20:45:20.000ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18052024-11-13T20:45:20.000ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b
18062024-11-13T20:45:20.024ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18072024-11-13T20:45:20.024ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2c90aa03-5691-4147-8289-5741cd7b19ba
18082024-11-13T20:45:20.050ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18092024-11-13T20:45:20.050ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_df67e3ea-c363-421d-9d4f-d05175051931
18102024-11-13T20:45:20.071ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18112024-11-13T20:45:20.071ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2
18122024-11-13T20:45:20.091ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18132024-11-13T20:45:20.091ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828
18142024-11-13T20:45:20.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 213877 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51244 req_id = b60260e1-9cc9-4faf-9bf8-d17fa2efb323 response_code = 200 uri = /inventory
18152024-11-13T20:45:20.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32860
18162024-11-13T20:45:20.920ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 75168899-d87d-49d2-8b98-d14f7b7eb489, kind: Service { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 }, name: Name("external-dns-c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a4ccb870-86a7-4151-a1d7-4db6b1a87752, kind: Service { id: a842ec92-0a47-4cf3-961b-d511caae6dde }, name: Name("external-dns-a842ec92-0a47-4cf3-961b-d511caae6dde"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a710b2c1-2d11-4fa8-853d-ebe0de1435fb, kind: Service { id: 40a99a76-55e2-4eca-9af8-34234c9027bd }, name: Name("nexus-40a99a76-55e2-4eca-9af8-34234c9027bd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc2e8e88-8497-4746-852d-c6030d315932, kind: Service { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc }, name: Name("nexus-29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dcbb36eb-ec28-4758-b092-0592208645d7, kind: Service { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee }, name: Name("nexus-38f04d99-7fed-47a2-afac-5c2bf6458bee"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 152])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18172024-11-13T20:45:20.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18182024-11-13T20:45:20.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18192024-11-13T20:45:20.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18202024-11-13T20:45:20.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18212024-11-13T20:45:20.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18222024-11-13T20:45:20.920ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18232024-11-13T20:45:20.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 738 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32860 req_id = f29212f0-012b-4789-a31a-fc439e587149 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18242024-11-13T20:45:20.921ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1083
18252024-11-13T20:45:21.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59730
18262024-11-13T20:45:21.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18272024-11-13T20:45:21.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18282024-11-13T20:45:21.137ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:177
18292024-11-13T20:45:21.137ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:177
18302024-11-13T20:45:21.148ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18312024-11-13T20:45:21.148ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_668784d0-9ec9-43d5-800e-a1a6d097030c
18322024-11-13T20:45:21.173ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18332024-11-13T20:45:21.173ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e43f0729-982f-4960-b10a-7966152ae48a
18342024-11-13T20:45:21.196ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18352024-11-13T20:45:21.196ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_94d47f77-b938-4683-89de-401156b9868f
18362024-11-13T20:45:21.216ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18372024-11-13T20:45:21.216ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8
18382024-11-13T20:45:21.235ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18392024-11-13T20:45:21.235ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b
18402024-11-13T20:45:21.254ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18412024-11-13T20:45:21.254ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2c90aa03-5691-4147-8289-5741cd7b19ba
18422024-11-13T20:45:21.273ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18432024-11-13T20:45:21.273ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_df67e3ea-c363-421d-9d4f-d05175051931
18442024-11-13T20:45:21.292ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18452024-11-13T20:45:21.292ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2
18462024-11-13T20:45:21.312ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18472024-11-13T20:45:21.312ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828
18482024-11-13T20:45:21.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 186889 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59730 req_id = 215550bb-1e9f-4d54-b048-6ace2824f927 response_code = 200 uri = /inventory
18492024-11-13T20:45:22.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38930
18502024-11-13T20:45:22.482ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 75168899-d87d-49d2-8b98-d14f7b7eb489, kind: Service { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 }, name: Name("external-dns-c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a4ccb870-86a7-4151-a1d7-4db6b1a87752, kind: Service { id: a842ec92-0a47-4cf3-961b-d511caae6dde }, name: Name("external-dns-a842ec92-0a47-4cf3-961b-d511caae6dde"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a710b2c1-2d11-4fa8-853d-ebe0de1435fb, kind: Service { id: 40a99a76-55e2-4eca-9af8-34234c9027bd }, name: Name("nexus-40a99a76-55e2-4eca-9af8-34234c9027bd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc2e8e88-8497-4746-852d-c6030d315932, kind: Service { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc }, name: Name("nexus-29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dcbb36eb-ec28-4758-b092-0592208645d7, kind: Service { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee }, name: Name("nexus-38f04d99-7fed-47a2-afac-5c2bf6458bee"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 152])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18512024-11-13T20:45:22.482ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18522024-11-13T20:45:22.482ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18532024-11-13T20:45:22.482ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18542024-11-13T20:45:22.482ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18552024-11-13T20:45:22.482ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18562024-11-13T20:45:22.482ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18572024-11-13T20:45:22.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38930 req_id = eab4cc8b-1df8-4576-928d-2175d03cb0b3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18582024-11-13T20:45:22.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62106
18592024-11-13T20:45:22.573ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 75168899-d87d-49d2-8b98-d14f7b7eb489, kind: Service { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 }, name: Name("external-dns-c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a4ccb870-86a7-4151-a1d7-4db6b1a87752, kind: Service { id: a842ec92-0a47-4cf3-961b-d511caae6dde }, name: Name("external-dns-a842ec92-0a47-4cf3-961b-d511caae6dde"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a710b2c1-2d11-4fa8-853d-ebe0de1435fb, kind: Service { id: 40a99a76-55e2-4eca-9af8-34234c9027bd }, name: Name("nexus-40a99a76-55e2-4eca-9af8-34234c9027bd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc2e8e88-8497-4746-852d-c6030d315932, kind: Service { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc }, name: Name("nexus-29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dcbb36eb-ec28-4758-b092-0592208645d7, kind: Service { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee }, name: Name("nexus-38f04d99-7fed-47a2-afac-5c2bf6458bee"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 152])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18602024-11-13T20:45:22.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18612024-11-13T20:45:22.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18622024-11-13T20:45:22.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18632024-11-13T20:45:22.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18642024-11-13T20:45:22.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18652024-11-13T20:45:22.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18662024-11-13T20:45:22.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62106 req_id = 07a3b557-d5ba-4231-8452-24ab5ec9c907 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18672024-11-13T20:45:22.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56845
18682024-11-13T20:45:22.813ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 75168899-d87d-49d2-8b98-d14f7b7eb489, kind: Service { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 }, name: Name("external-dns-c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a4ccb870-86a7-4151-a1d7-4db6b1a87752, kind: Service { id: a842ec92-0a47-4cf3-961b-d511caae6dde }, name: Name("external-dns-a842ec92-0a47-4cf3-961b-d511caae6dde"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a710b2c1-2d11-4fa8-853d-ebe0de1435fb, kind: Service { id: 40a99a76-55e2-4eca-9af8-34234c9027bd }, name: Name("nexus-40a99a76-55e2-4eca-9af8-34234c9027bd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc2e8e88-8497-4746-852d-c6030d315932, kind: Service { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc }, name: Name("nexus-29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dcbb36eb-ec28-4758-b092-0592208645d7, kind: Service { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee }, name: Name("nexus-38f04d99-7fed-47a2-afac-5c2bf6458bee"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 152])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18692024-11-13T20:45:22.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18702024-11-13T20:45:22.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18712024-11-13T20:45:22.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18722024-11-13T20:45:22.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18732024-11-13T20:45:22.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18742024-11-13T20:45:22.813ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18752024-11-13T20:45:22.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56845 req_id = 4a8ceae4-e79e-43e3-937d-a3f4d7f345b6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18762024-11-13T20:45:27.650ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18772024-11-13T20:45:28.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51630
18782024-11-13T20:45:28.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51630 req_id = 123ae89a-5db4-4194-9e4f-640ae62e3e6a response_code = 200 uri = /vpc-routes
18792024-11-13T20:45:28.411ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
18802024-11-13T20:45:28.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51630 req_id = d2bf1e56-4859-4bf7-ae20-bf9e0f7d2cd7 response_code = 204 uri = /eip-gateways
18812024-11-13T20:45:28.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51630 req_id = b6e77b6f-55c6-43d9-af5f-23f9dbf721e9 response_code = 204 uri = /vpc-routes
18822024-11-13T20:45:34.640ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52279
18832024-11-13T20:45:34.640ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52279 req_id = d126a374-f8ce-4b87-acff-a27c840041b2 response_code = 200 uri = /baseboard
18842024-11-13T20:45:44.511ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:53447 remote_addr = [fd00:1122:3344:101::d]:44036 sled_id = b6e177bd-5357-4f01-b047-206109321c43
18852024-11-13T20:45:44.525ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 13766 local_addr = [fd00:1122:3344:101::1]:53447 method = GET remote_addr = [fd00:1122:3344:101::d]:44036 req_id = 56138b83-843d-4672-ae11-6a57252d3c06 response_code = 200 sled_id = b6e177bd-5357-4f01-b047-206109321c43 uri = /b6e177bd-5357-4f01-b047-206109321c43
18862024-11-13T20:45:48.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52217
18872024-11-13T20:45:48.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52217 req_id = 7cb0f7bf-e4d1-4834-8f29-4c48ce7f4403 response_code = 200 uri = /vpc-routes
18882024-11-13T20:45:48.323ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
18892024-11-13T20:45:48.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52217 req_id = d074fd69-fc74-48d4-b312-9be2798a4e1c response_code = 204 uri = /eip-gateways
18902024-11-13T20:45:48.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52217 req_id = e0b36f0a-7f3d-4b83-ba35-6cc5be44920c response_code = 204 uri = /vpc-routes
18912024-11-13T20:45:48.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35104
18922024-11-13T20:45:48.413ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18932024-11-13T20:45:48.463ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18942024-11-13T20:45:48.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110192 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35104 req_id = 3398c808-8937-4d1f-9640-e6286f8d46a5 response_code = 204 uri = /switch-ports
18952024-11-13T20:45:48.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40384
18962024-11-13T20:45:48.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40384 req_id = 43ce8780-56c0-4caf-9295-455dacff3176 response_code = 200 uri = /v2p
18972024-11-13T20:45:48.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 478 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35104 req_id = dd7357e9-3d95-4f53-aab4-44b764c234bd response_code = 200 uri = /network-bootstore-config
18982024-11-13T20:45:48.550ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18992024-11-13T20:45:48.550ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19002024-11-13T20:45:48.550ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
19012024-11-13T20:45:48.551ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
19022024-11-13T20:45:48.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1782 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35104 req_id = 4684ca50-0cc9-4ea8-8ee0-11906ad6d582 response_code = 204 uri = /network-bootstore-config
19032024-11-13T20:45:49.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49096
19042024-11-13T20:45:49.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49096 req_id = 54b7b26e-17f5-463b-baa3-2ba0488de9ea response_code = 200 uri = /vpc-routes
19052024-11-13T20:45:49.213ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
19062024-11-13T20:45:49.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49096 req_id = af6c16e6-9865-4dd3-b1e1-d6da1f4dfc74 response_code = 204 uri = /eip-gateways
19072024-11-13T20:45:49.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49096 req_id = 4d97b7ab-3664-4394-a8b3-8e93f7614baa response_code = 204 uri = /vpc-routes
19082024-11-13T20:45:49.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47252
19092024-11-13T20:45:49.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47252 req_id = 8646e025-a207-4e42-892e-21b11e11484c response_code = 200 uri = /v2p
19102024-11-13T20:45:49.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63181
19112024-11-13T20:45:49.414ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19122024-11-13T20:45:49.453ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19132024-11-13T20:45:49.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94910 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63181 req_id = 3a32c432-b127-415b-ac9e-66375da85972 response_code = 204 uri = /switch-ports
19142024-11-13T20:45:49.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57564
19152024-11-13T20:45:49.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35073
19162024-11-13T20:45:49.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57564 req_id = b5625136-a557-4407-b1f3-b4a922b843a1 response_code = 200 uri = /vpc-routes
19172024-11-13T20:45:49.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35073 req_id = 41b0dce2-ee92-4259-ba2a-73d4cf725dbb response_code = 200 uri = /v2p
19182024-11-13T20:45:49.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63181 req_id = 831e4f84-2a4a-421c-a03b-ddb6956f47a9 response_code = 200 uri = /network-bootstore-config
19192024-11-13T20:45:49.555ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
19202024-11-13T20:45:49.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57564 req_id = ca4cddb0-dfbf-48a1-b344-4978123df6d5 response_code = 204 uri = /eip-gateways
19212024-11-13T20:45:49.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57564 req_id = ff5edb63-77b2-4559-84aa-815dfb7d2b5f response_code = 204 uri = /vpc-routes
19222024-11-13T20:45:49.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34183
19232024-11-13T20:45:49.577ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19242024-11-13T20:45:49.614ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19252024-11-13T20:45:49.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91502 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34183 req_id = 2c5c25ec-9815-4e41-83e0-ef8bcec3df5a response_code = 204 uri = /switch-ports
19262024-11-13T20:45:49.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34183 req_id = 9c962d64-dc3f-45ad-b7b8-d344d5b08382 response_code = 200 uri = /network-bootstore-config
19272024-11-13T20:46:04.673ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56046
19282024-11-13T20:46:04.673ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56046 req_id = 8caa31de-f217-4b46-ba6a-7e725777080c response_code = 200 uri = /baseboard
19292024-11-13T20:46:18.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53387
19302024-11-13T20:46:18.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53387 req_id = 37696ff6-6ef4-49fc-8eaf-1d485d4e5521 response_code = 200 uri = /vpc-routes
19312024-11-13T20:46:18.382ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
19322024-11-13T20:46:18.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53387 req_id = 409482c1-7814-4280-8836-504487f6093b response_code = 204 uri = /eip-gateways
19332024-11-13T20:46:18.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53387 req_id = da64fe3b-ae8a-4088-beb6-d3d5b2913b83 response_code = 204 uri = /vpc-routes
19342024-11-13T20:46:18.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61251
19352024-11-13T20:46:18.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61251 req_id = 9968e424-3127-493c-a229-a823f1b5cf11 response_code = 200 uri = /v2p
19362024-11-13T20:46:18.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33535
19372024-11-13T20:46:18.653ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19382024-11-13T20:46:18.690ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19392024-11-13T20:46:18.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91224 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33535 req_id = 81cf1fe9-475c-4001-8377-fa92547ee344 response_code = 204 uri = /switch-ports
19402024-11-13T20:46:18.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33535 req_id = fb8f054b-318d-4230-8d79-c4d127dc0120 response_code = 200 uri = /network-bootstore-config
19412024-11-13T20:46:19.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42117
19422024-11-13T20:46:19.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42117 req_id = 9ea908b0-a0ca-4d5b-b9a8-3ef9d1c3d068 response_code = 200 uri = /vpc-routes
19432024-11-13T20:46:19.290ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
19442024-11-13T20:46:19.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42117 req_id = 7d3ba937-42fb-4e6b-a14d-5456e1320e1a response_code = 204 uri = /eip-gateways
19452024-11-13T20:46:19.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 385 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42117 req_id = 82b09f77-1fa4-47a3-b8a2-d6418de525b4 response_code = 204 uri = /vpc-routes
19462024-11-13T20:46:19.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56898
19472024-11-13T20:46:19.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56898 req_id = a99df6ab-73c6-4308-a15b-f1e7f94f92a9 response_code = 200 uri = /v2p
19482024-11-13T20:46:19.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48473
19492024-11-13T20:46:19.528ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19502024-11-13T20:46:19.569ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19512024-11-13T20:46:19.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96554 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48473 req_id = 9100a787-7f88-4257-a83b-775fb9f10866 response_code = 204 uri = /switch-ports
19522024-11-13T20:46:19.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57429
19532024-11-13T20:46:19.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57429 req_id = 7d6c77c3-ed7e-4380-a8c6-50c5fbb35291 response_code = 200 uri = /vpc-routes
19542024-11-13T20:46:19.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48473 req_id = 190afc0b-74dc-40c4-bb83-a56edfe13aeb response_code = 200 uri = /network-bootstore-config
19552024-11-13T20:46:19.674ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
19562024-11-13T20:46:19.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57429 req_id = a1d1c824-a5e4-4522-89bf-495e975913ea response_code = 204 uri = /eip-gateways
19572024-11-13T20:46:19.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42204
19582024-11-13T20:46:19.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42204 req_id = be217096-81be-47a6-a9a6-3aa4795f074c response_code = 200 uri = /v2p
19592024-11-13T20:46:19.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57429 req_id = 757afac1-63f7-44f2-8402-35e1120e1ce1 response_code = 204 uri = /vpc-routes
19602024-11-13T20:46:20.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54820
19612024-11-13T20:46:20.040ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19622024-11-13T20:46:20.078ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19632024-11-13T20:46:20.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54820 req_id = c6949bc4-c4ce-4314-b51e-6c851fd5e378 response_code = 204 uri = /switch-ports
19642024-11-13T20:46:20.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54820 req_id = 73f4c9a4-901b-4733-81d6-6a57f9497727 response_code = 200 uri = /network-bootstore-config
19652024-11-13T20:46:34.712ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43969
19662024-11-13T20:46:34.712ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43969 req_id = 47010eb1-2897-49ee-9cd6-0c57dd73b563 response_code = 200 uri = /baseboard
19672024-11-13T20:46:48.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60569
19682024-11-13T20:46:48.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60569 req_id = 89873624-82c6-455d-90b4-29c2ab686a63 response_code = 200 uri = /vpc-routes
19692024-11-13T20:46:48.410ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
19702024-11-13T20:46:48.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60569 req_id = 6fb80169-823f-484a-bdb1-2f3bc3846bca response_code = 204 uri = /eip-gateways
19712024-11-13T20:46:48.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44608
19722024-11-13T20:46:48.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44608 req_id = 0a13b361-cd5c-4e61-a9e5-6cc45f264c46 response_code = 200 uri = /v2p
19732024-11-13T20:46:48.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43886
19742024-11-13T20:46:48.456ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19752024-11-13T20:46:48.491ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19762024-11-13T20:46:48.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88541 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43886 req_id = 3d6db1fc-0747-48d3-869c-4e455f887b1d response_code = 204 uri = /switch-ports
19772024-11-13T20:46:48.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43886 req_id = 691cd1d6-0b07-4dcf-b49e-4db305d26fa6 response_code = 200 uri = /network-bootstore-config
19782024-11-13T20:46:48.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60569 req_id = bc6e78de-606c-4494-ac34-7c83946a1bf4 response_code = 204 uri = /vpc-routes
19792024-11-13T20:46:49.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44232
19802024-11-13T20:46:49.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44232 req_id = 5e9ed568-cab3-4e37-b76d-e4fbc0ef3d76 response_code = 200 uri = /vpc-routes
19812024-11-13T20:46:49.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
19822024-11-13T20:46:49.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44232 req_id = 672bcf06-7a12-4224-9601-f3982f301012 response_code = 204 uri = /eip-gateways
19832024-11-13T20:46:49.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44232 req_id = 51c55f7a-4ff8-42bb-9eda-26e59ec20de0 response_code = 204 uri = /vpc-routes
19842024-11-13T20:46:49.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37497
19852024-11-13T20:46:49.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37497 req_id = 9d2dfa3c-dc15-4216-a70f-0f3c61c34117 response_code = 200 uri = /v2p
19862024-11-13T20:46:49.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56873
19872024-11-13T20:46:49.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56873 req_id = 0b8e7bf8-d075-4dd0-ab6a-95f7046df786 response_code = 200 uri = /vpc-routes
19882024-11-13T20:46:49.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45153
19892024-11-13T20:46:49.411ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19902024-11-13T20:46:49.446ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19912024-11-13T20:46:49.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88395 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45153 req_id = 5d6cd9f5-6f18-4d1a-b7d2-ff09beebb0b5 response_code = 204 uri = /switch-ports
19922024-11-13T20:46:49.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37971
19932024-11-13T20:46:49.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37971 req_id = c3ad6870-b22f-4e7a-b76c-e562a3e0ccab response_code = 200 uri = /v2p
19942024-11-13T20:46:49.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45153 req_id = 66ff861b-014a-4f44-9884-ef9055e410a6 response_code = 200 uri = /network-bootstore-config
19952024-11-13T20:46:49.526ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
19962024-11-13T20:46:49.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56873 req_id = b4546ff6-4e3b-46c5-abb8-62ec8e7f086e response_code = 204 uri = /eip-gateways
19972024-11-13T20:46:49.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56873 req_id = 926123a8-39af-4c4b-b5e9-ecd94b08ad4a response_code = 204 uri = /vpc-routes
19982024-11-13T20:46:49.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58286
19992024-11-13T20:46:49.658ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20002024-11-13T20:46:49.695ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20012024-11-13T20:46:49.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87323 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58286 req_id = 4e301523-2c52-46d5-85fd-2c72bf07c009 response_code = 204 uri = /switch-ports
20022024-11-13T20:46:49.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58286 req_id = e9781e5d-0cfb-498c-b58d-5021b4b728a3 response_code = 200 uri = /network-bootstore-config
20032024-11-13T20:47:04.746ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59591
20042024-11-13T20:47:04.746ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59591 req_id = 2fa85e54-1edf-45d4-ad20-76b48b9f539c response_code = 200 uri = /baseboard
20052024-11-13T20:47:18.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54366
20062024-11-13T20:47:18.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54366 req_id = bc02732a-6f54-4431-86cc-2f94d23f487c response_code = 200 uri = /vpc-routes
20072024-11-13T20:47:18.317ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
20082024-11-13T20:47:18.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54366 req_id = 6dd4d1fb-c870-4088-b68e-4dadd5a60fad response_code = 204 uri = /eip-gateways
20092024-11-13T20:47:18.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54366 req_id = 368aa521-6ec0-439b-aa27-b760590a205d response_code = 204 uri = /vpc-routes
20102024-11-13T20:47:18.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33233
20112024-11-13T20:47:18.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33233 req_id = ddb078f1-90cc-4ac9-b19f-e98dbce750cb response_code = 200 uri = /v2p
20122024-11-13T20:47:18.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39202
20132024-11-13T20:47:18.724ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20142024-11-13T20:47:18.761ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20152024-11-13T20:47:18.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93263 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39202 req_id = f317a16d-48af-493d-8165-58079d8de5a9 response_code = 204 uri = /switch-ports
20162024-11-13T20:47:18.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39202 req_id = a845db10-bfa4-49fc-b112-285a835375b4 response_code = 200 uri = /network-bootstore-config
20172024-11-13T20:47:19.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54351
20182024-11-13T20:47:19.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54351 req_id = d3f0f830-7a70-477d-a730-052817ae687e response_code = 200 uri = /vpc-routes
20192024-11-13T20:47:19.439ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
20202024-11-13T20:47:19.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54351 req_id = d6c7ab41-886d-4d9d-af05-b602cb80204c response_code = 204 uri = /eip-gateways
20212024-11-13T20:47:19.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44564
20222024-11-13T20:47:19.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44564 req_id = a3aa9193-1f87-47e9-9598-89eeb909b7c5 response_code = 200 uri = /v2p
20232024-11-13T20:47:19.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54351 req_id = 919aaaf9-f9d5-473d-aefc-8343a0c69e59 response_code = 204 uri = /vpc-routes
20242024-11-13T20:47:19.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49162
20252024-11-13T20:47:19.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49162 req_id = 663c3543-0f08-4d0f-92c7-ce5a940621ec response_code = 200 uri = /vpc-routes
20262024-11-13T20:47:19.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48869
20272024-11-13T20:47:19.677ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20282024-11-13T20:47:19.717ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20292024-11-13T20:47:19.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98914 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48869 req_id = 2edfb43a-c635-4b1d-acae-a4499f8e7332 response_code = 204 uri = /switch-ports
20302024-11-13T20:47:19.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61275
20312024-11-13T20:47:19.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48869 req_id = 653374ee-dd0e-467a-b387-956a329463c1 response_code = 200 uri = /network-bootstore-config
20322024-11-13T20:47:19.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61275 req_id = 00728d4b-cda0-416e-a3ff-b2da67022b3a response_code = 200 uri = /v2p
20332024-11-13T20:47:19.807ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
20342024-11-13T20:47:19.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49162 req_id = 3b50e384-fbc2-4e17-8d51-719b30210d5e response_code = 204 uri = /eip-gateways
20352024-11-13T20:47:19.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49162 req_id = 1b614f95-5b6b-4187-b1ae-d1fb663ac918 response_code = 204 uri = /vpc-routes
20362024-11-13T20:47:19.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55315
20372024-11-13T20:47:19.818ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20382024-11-13T20:47:19.851ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20392024-11-13T20:47:19.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88264 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55315 req_id = c02d7b3f-3db1-4afa-8110-29379710a652 response_code = 204 uri = /switch-ports
20402024-11-13T20:47:19.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55315 req_id = 0a56d045-4c53-43aa-91d1-e29ed6801e5b response_code = 200 uri = /network-bootstore-config
20412024-11-13T20:47:34.784ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43307
20422024-11-13T20:47:34.785ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43307 req_id = b0924dc5-8d96-4ff9-8a4a-d0a7c02daefd response_code = 200 uri = /baseboard
20432024-11-13T20:47:48.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55306
20442024-11-13T20:47:48.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55306 req_id = 5cf3d7a1-cde1-4930-b2d9-cdb494c2da83 response_code = 200 uri = /vpc-routes
20452024-11-13T20:47:48.300ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
20462024-11-13T20:47:48.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55306 req_id = d101ebd3-f487-4199-8698-aac4afbb7df6 response_code = 204 uri = /eip-gateways
20472024-11-13T20:47:48.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55306 req_id = d2a8111c-7cc0-4b25-a807-7345a462fb80 response_code = 204 uri = /vpc-routes
20482024-11-13T20:47:48.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36909
20492024-11-13T20:47:48.372ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20502024-11-13T20:47:48.414ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20512024-11-13T20:47:48.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97083 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36909 req_id = 5b74ca6f-9742-4d52-8647-53bdfdb85f65 response_code = 204 uri = /switch-ports
20522024-11-13T20:47:48.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57125
20532024-11-13T20:47:48.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57125 req_id = c7368196-fd81-4b38-aa01-7facb84c63c4 response_code = 200 uri = /v2p
20542024-11-13T20:47:48.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36909 req_id = 5681b760-f10b-4f50-b21a-e4e29567f675 response_code = 200 uri = /network-bootstore-config
20552024-11-13T20:47:49.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56605
20562024-11-13T20:47:49.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56605 req_id = 9b740c4b-e1bb-4869-8ee5-32195785061c response_code = 200 uri = /vpc-routes
20572024-11-13T20:47:49.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
20582024-11-13T20:47:49.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56605 req_id = e598d22d-b032-4733-a74d-75137fc16e19 response_code = 204 uri = /eip-gateways
20592024-11-13T20:47:49.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56605 req_id = d864bcd9-5158-4763-9924-1a1d488be6c9 response_code = 204 uri = /vpc-routes
20602024-11-13T20:47:49.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46312
20612024-11-13T20:47:49.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46312 req_id = 503738ed-36c5-40d7-8ccd-1b69543e98a0 response_code = 200 uri = /v2p
20622024-11-13T20:47:49.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46335
20632024-11-13T20:47:49.280ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20642024-11-13T20:47:49.315ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20652024-11-13T20:47:49.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90981 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46335 req_id = 93822a42-e6e1-4a48-9ee8-b33cb374a6b7 response_code = 204 uri = /switch-ports
20662024-11-13T20:47:49.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46335 req_id = b5d844e3-0f00-434a-98b2-f52724915d13 response_code = 200 uri = /network-bootstore-config
20672024-11-13T20:47:49.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65247
20682024-11-13T20:47:49.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65247 req_id = 8b0a0650-6da5-47c3-a0e7-39e02f27aafb response_code = 200 uri = /vpc-routes
20692024-11-13T20:47:49.490ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
20702024-11-13T20:47:49.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65247 req_id = 29de0537-33bc-4846-ac7f-987477963b34 response_code = 204 uri = /eip-gateways
20712024-11-13T20:47:49.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65247 req_id = 7a613073-6a39-43be-b871-361c449b4b45 response_code = 204 uri = /vpc-routes
20722024-11-13T20:47:49.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52792
20732024-11-13T20:47:49.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52792 req_id = adf3e93e-b096-41a0-ab54-37a7749417ed response_code = 200 uri = /v2p
20742024-11-13T20:47:49.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61367
20752024-11-13T20:47:49.617ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20762024-11-13T20:47:49.657ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20772024-11-13T20:47:49.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94175 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61367 req_id = 94d2bcef-a5d9-4872-9f16-ae409d0d603e response_code = 204 uri = /switch-ports
20782024-11-13T20:47:49.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61367 req_id = 1b3357b3-6fd0-43cc-85ee-11714184143c response_code = 200 uri = /network-bootstore-config
20792024-11-13T20:48:04.818ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58110
20802024-11-13T20:48:04.818ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58110 req_id = 6c6a69a6-ec08-4db2-9c9f-ff1fb552d615 response_code = 200 uri = /baseboard
20812024-11-13T20:48:18.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46465
20822024-11-13T20:48:18.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46465 req_id = 684dac40-b138-4aa2-8483-d63631f26f4e response_code = 200 uri = /vpc-routes
20832024-11-13T20:48:18.432ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
20842024-11-13T20:48:18.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46465 req_id = 55d59fb5-1e69-45ec-b96a-1591603fdff6 response_code = 204 uri = /eip-gateways
20852024-11-13T20:48:18.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46465 req_id = 30d12761-ce90-46d2-aeef-93228994524f response_code = 204 uri = /vpc-routes
20862024-11-13T20:48:18.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50663
20872024-11-13T20:48:18.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50663 req_id = 0e2b28b5-15e9-4aff-b104-b0c8143590fc response_code = 200 uri = /v2p
20882024-11-13T20:48:18.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35026
20892024-11-13T20:48:18.649ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20902024-11-13T20:48:18.682ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20912024-11-13T20:48:18.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86966 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35026 req_id = c8a53e93-7252-426a-a2c9-0c9a0dc5c412 response_code = 204 uri = /switch-ports
20922024-11-13T20:48:18.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35026 req_id = df5444ad-2edd-48f1-82bb-e352be774cca response_code = 200 uri = /network-bootstore-config
20932024-11-13T20:48:19.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44048
20942024-11-13T20:48:19.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44048 req_id = 02df79dd-9429-4b0f-be55-c084db2d3b49 response_code = 200 uri = /vpc-routes
20952024-11-13T20:48:19.352ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
20962024-11-13T20:48:19.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44048 req_id = e5f6d7ca-c32c-4037-aa2a-672e90fa2e04 response_code = 204 uri = /eip-gateways
20972024-11-13T20:48:19.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44048 req_id = a44a4a35-cf20-4d75-aef2-c766fded3fcd response_code = 204 uri = /vpc-routes
20982024-11-13T20:48:19.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58348
20992024-11-13T20:48:19.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58348 req_id = 18eb3694-5cd1-4d67-8f22-87eba1b2c7d2 response_code = 200 uri = /v2p
21002024-11-13T20:48:19.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41603
21012024-11-13T20:48:19.539ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21022024-11-13T20:48:19.577ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21032024-11-13T20:48:19.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94968 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41603 req_id = 6a78b055-5c9e-4375-b0ff-69ada891a358 response_code = 204 uri = /switch-ports
21042024-11-13T20:48:19.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41603 req_id = 90b946ae-9a4d-49c2-8331-d4d9ec2c9422 response_code = 200 uri = /network-bootstore-config
21052024-11-13T20:48:19.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37648
21062024-11-13T20:48:19.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37648 req_id = c00fd556-2331-4b94-b6d6-7cdd52c050d5 response_code = 200 uri = /vpc-routes
21072024-11-13T20:48:19.736ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
21082024-11-13T20:48:19.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37648 req_id = 553e0535-9311-4135-b7d3-bf0b258b4943 response_code = 204 uri = /eip-gateways
21092024-11-13T20:48:19.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37648 req_id = 6485e9b5-12da-43db-9d68-fc00bcca402d response_code = 204 uri = /vpc-routes
21102024-11-13T20:48:19.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34003
21112024-11-13T20:48:19.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34003 req_id = a6237f4b-0c43-4252-ad8f-1a319d8fd0a4 response_code = 200 uri = /v2p
21122024-11-13T20:48:19.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35515
21132024-11-13T20:48:19.842ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21142024-11-13T20:48:19.878ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21152024-11-13T20:48:19.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88278 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35515 req_id = fd119257-b739-442a-b175-0defc31c394e response_code = 204 uri = /switch-ports
21162024-11-13T20:48:19.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35515 req_id = d55082ce-0e60-4416-bb65-dc7f31b59f72 response_code = 200 uri = /network-bootstore-config
21172024-11-13T20:48:34.850ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65091
21182024-11-13T20:48:34.851ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65091 req_id = 586bf196-2949-445c-951b-40e2d4cf31cd response_code = 200 uri = /baseboard
21192024-11-13T20:48:48.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58416
21202024-11-13T20:48:48.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58416 req_id = 8b792fe2-96b4-4ad9-9a2a-899dc0e950e3 response_code = 200 uri = /vpc-routes
21212024-11-13T20:48:48.382ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
21222024-11-13T20:48:48.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58416 req_id = b20a83ff-666a-43aa-a241-afc4c507e473 response_code = 204 uri = /eip-gateways
21232024-11-13T20:48:48.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41228
21242024-11-13T20:48:48.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41228 req_id = cb80694e-d828-4c18-83bb-dadd75683c20 response_code = 200 uri = /v2p
21252024-11-13T20:48:48.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58416 req_id = e60a21f3-c489-4d78-8b3e-243aa57ca5b1 response_code = 204 uri = /vpc-routes
21262024-11-13T20:48:48.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47671
21272024-11-13T20:48:48.456ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21282024-11-13T20:48:48.493ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21292024-11-13T20:48:48.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88767 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47671 req_id = 8fb0b0e4-df7a-452f-915a-16a058db17ef response_code = 204 uri = /switch-ports
21302024-11-13T20:48:48.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47671 req_id = 41a3b0b0-40fa-43a3-a51f-d329d8080ddb response_code = 200 uri = /network-bootstore-config
21312024-11-13T20:48:49.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50020
21322024-11-13T20:48:49.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50020 req_id = 5ddd7d0b-5bb5-44d0-9b5b-ed43084c65f0 response_code = 200 uri = /vpc-routes
21332024-11-13T20:48:49.204ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
21342024-11-13T20:48:49.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50020 req_id = 2e5c69a6-96a9-471b-9c50-0c7cd4f4b42e response_code = 204 uri = /eip-gateways
21352024-11-13T20:48:49.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50020 req_id = 8cfd24a6-4230-4add-8e16-597834a4980f response_code = 204 uri = /vpc-routes
21362024-11-13T20:48:49.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64689
21372024-11-13T20:48:49.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64689 req_id = b2d925db-3c7f-4622-8f55-dd05253a494b response_code = 200 uri = /v2p
21382024-11-13T20:48:49.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40967
21392024-11-13T20:48:49.336ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21402024-11-13T20:48:49.377ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21412024-11-13T20:48:49.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103888 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40967 req_id = a2895804-dbf3-4d08-9400-f561742ab369 response_code = 204 uri = /switch-ports
21422024-11-13T20:48:49.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33866
21432024-11-13T20:48:49.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33866 req_id = 81751a01-7dbb-4868-8eae-e586d7895d3f response_code = 200 uri = /vpc-routes
21442024-11-13T20:48:49.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40967 req_id = f5264211-9e87-4743-a7ba-d17ee515dd89 response_code = 200 uri = /network-bootstore-config
21452024-11-13T20:48:49.484ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
21462024-11-13T20:48:49.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33866 req_id = e7b36421-1c5b-4b5c-ad14-5f7d27be3cf1 response_code = 204 uri = /eip-gateways
21472024-11-13T20:48:49.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33866 req_id = 5fcb3cde-3165-467e-918e-f6e38afce99e response_code = 204 uri = /vpc-routes
21482024-11-13T20:48:49.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47276
21492024-11-13T20:48:49.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47276 req_id = 348fb0eb-dc96-4ea2-9f66-2824a2b79301 response_code = 200 uri = /v2p
21502024-11-13T20:48:49.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46573
21512024-11-13T20:48:49.759ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21522024-11-13T20:48:49.797ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21532024-11-13T20:48:49.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92607 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46573 req_id = 91684146-309b-40d4-a01a-e9150d6adb7c response_code = 204 uri = /switch-ports
21542024-11-13T20:48:49.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46573 req_id = 71d48259-fd74-4d01-9977-ac5234aaebbf response_code = 200 uri = /network-bootstore-config
21552024-11-13T20:49:04.883ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42115
21562024-11-13T20:49:04.883ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42115 req_id = e1daddf6-ded5-431e-9dab-a4ed0ab94124 response_code = 200 uri = /baseboard
21572024-11-13T20:49:18.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59282
21582024-11-13T20:49:18.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59282 req_id = 7ac96e6a-b0f0-47ad-b721-cf5d72e6f311 response_code = 200 uri = /vpc-routes
21592024-11-13T20:49:18.290ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
21602024-11-13T20:49:18.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59282 req_id = b6c9eb60-8ef3-4b3e-ac7a-60849618356f response_code = 204 uri = /eip-gateways
21612024-11-13T20:49:18.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59282 req_id = 5f5060a9-72ac-4e0e-8852-ab2d2108cdfa response_code = 204 uri = /vpc-routes
21622024-11-13T20:49:18.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53586
21632024-11-13T20:49:18.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53586 req_id = 38ef240b-b7b9-46f4-b62e-ea5c4d04c4dc response_code = 200 uri = /v2p
21642024-11-13T20:49:18.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60678
21652024-11-13T20:49:18.660ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21662024-11-13T20:49:18.697ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21672024-11-13T20:49:18.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91794 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60678 req_id = 8f4f8296-d390-4807-b5d6-571f56bc7e54 response_code = 204 uri = /switch-ports
21682024-11-13T20:49:18.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60678 req_id = c6a2081a-77fb-4e84-868f-a20c672906f1 response_code = 200 uri = /network-bootstore-config
21692024-11-13T20:49:19.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33485
21702024-11-13T20:49:19.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33485 req_id = 699f07bd-d458-4993-8391-8e6da1b64084 response_code = 200 uri = /vpc-routes
21712024-11-13T20:49:19.438ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
21722024-11-13T20:49:19.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33485 req_id = a06376c0-5c05-48b5-b2c6-9d88d8885f94 response_code = 204 uri = /eip-gateways
21732024-11-13T20:49:19.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33485 req_id = 3ff6fcbc-8012-40e1-aef7-6acf429302ba response_code = 204 uri = /vpc-routes
21742024-11-13T20:49:19.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57029
21752024-11-13T20:49:19.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57029 req_id = dbd9f33c-2df9-4223-9220-aaec123ec1eb response_code = 200 uri = /vpc-routes
21762024-11-13T20:49:19.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49913
21772024-11-13T20:49:19.487ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21782024-11-13T20:49:19.544ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21792024-11-13T20:49:19.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49913 req_id = 10f47573-4b7c-434c-8327-5f1a8419a70a response_code = 204 uri = /switch-ports
21802024-11-13T20:49:19.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50558
21812024-11-13T20:49:19.625ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
21822024-11-13T20:49:19.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57029 req_id = be739187-c4e3-4c49-9bab-8291ec2091be response_code = 204 uri = /eip-gateways
21832024-11-13T20:49:19.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49913 req_id = a4d3a5c6-f709-4661-8926-6191f7021d32 response_code = 200 uri = /network-bootstore-config
21842024-11-13T20:49:19.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50558 req_id = db46eef7-b9e4-4896-bdf6-1fc59b760309 response_code = 200 uri = /v2p
21852024-11-13T20:49:19.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57029 req_id = faffec66-bfe4-4a06-9a54-58d8ba1c9f6e response_code = 204 uri = /vpc-routes
21862024-11-13T20:49:19.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37963
21872024-11-13T20:49:19.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37963 req_id = 43a970bc-c14b-4379-9367-95f76eb7dfc1 response_code = 200 uri = /v2p
21882024-11-13T20:49:19.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61952
21892024-11-13T20:49:19.788ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21902024-11-13T20:49:19.826ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21912024-11-13T20:49:19.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95270 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61952 req_id = e4833171-48c4-47ee-8fc5-aa98b4f61520 response_code = 204 uri = /switch-ports
21922024-11-13T20:49:19.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61952 req_id = 8a7dd79d-0e31-4a54-a844-156dd144a09a response_code = 200 uri = /network-bootstore-config
21932024-11-13T20:49:34.918ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46778
21942024-11-13T20:49:34.919ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46778 req_id = f9434e46-2630-4db0-b773-88b946092f50 response_code = 200 uri = /baseboard
21952024-11-13T20:49:48.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55170
21962024-11-13T20:49:48.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55170 req_id = e270abe8-9c45-4c37-99c5-139893d91f55 response_code = 200 uri = /vpc-routes
21972024-11-13T20:49:48.268ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
21982024-11-13T20:49:48.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55170 req_id = b9656fa3-4429-478c-8cc2-ab78d44a63b9 response_code = 204 uri = /eip-gateways
21992024-11-13T20:49:48.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55170 req_id = 93bbca53-0d54-42c4-8282-1f9c13d580e5 response_code = 204 uri = /vpc-routes
22002024-11-13T20:49:48.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39698
22012024-11-13T20:49:48.304ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22022024-11-13T20:49:48.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22032024-11-13T20:49:48.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95478 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39698 req_id = 514a3b5c-cc76-4a1d-add2-b49fcecaa92c response_code = 204 uri = /switch-ports
22042024-11-13T20:49:48.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39698 req_id = 8aa95d62-800f-4f4c-9428-22f13ff05c5e response_code = 200 uri = /network-bootstore-config
22052024-11-13T20:49:48.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46263
22062024-11-13T20:49:48.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46263 req_id = bd19e43d-835a-48ed-836e-98af92d19f83 response_code = 200 uri = /v2p
22072024-11-13T20:49:49.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65509
22082024-11-13T20:49:49.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65509 req_id = 71e10a63-9ed4-45fd-9cae-871c6fde650e response_code = 200 uri = /vpc-routes
22092024-11-13T20:49:49.252ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
22102024-11-13T20:49:49.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65509 req_id = fbba1e48-1cf7-4007-8c84-79714536bbea response_code = 204 uri = /eip-gateways
22112024-11-13T20:49:49.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52418
22122024-11-13T20:49:49.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52418 req_id = 57cc94d3-79f4-43c7-8395-de836fbab538 response_code = 200 uri = /v2p
22132024-11-13T20:49:49.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65509 req_id = bfec9a9c-6ad9-4048-870b-403a9fa365d1 response_code = 204 uri = /vpc-routes
22142024-11-13T20:49:49.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61909
22152024-11-13T20:49:49.352ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22162024-11-13T20:49:49.391ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22172024-11-13T20:49:49.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99239 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61909 req_id = 5fa2a5a2-5aec-4561-b0ec-042fdb34fb27 response_code = 204 uri = /switch-ports
22182024-11-13T20:49:49.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48391
22192024-11-13T20:49:49.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61909 req_id = f70cb1c7-873a-494c-9da7-46558765fdc0 response_code = 200 uri = /network-bootstore-config
22202024-11-13T20:49:49.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48391 req_id = a9507f2b-d527-47a9-bcf8-3f0e54fadd1d response_code = 200 uri = /vpc-routes
22212024-11-13T20:49:49.470ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
22222024-11-13T20:49:49.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48391 req_id = de7ef108-3459-41a4-ac31-114b94a1f767 response_code = 204 uri = /eip-gateways
22232024-11-13T20:49:49.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43440
22242024-11-13T20:49:49.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43440 req_id = 1e7203e1-17e6-4057-81fe-25c0e1da5ace response_code = 200 uri = /v2p
22252024-11-13T20:49:49.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48391 req_id = d3ac6980-d4e4-4ff1-9e9e-e3e7b9f47135 response_code = 204 uri = /vpc-routes
22262024-11-13T20:49:49.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40746
22272024-11-13T20:49:49.560ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22282024-11-13T20:49:49.598ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22292024-11-13T20:49:49.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93100 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40746 req_id = 5c115e85-8a0b-4a59-9ba2-06ec1efe96cf response_code = 204 uri = /switch-ports
22302024-11-13T20:49:49.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40746 req_id = 5ef06032-7359-4fcd-a5ed-b4e14d06f92e response_code = 200 uri = /network-bootstore-config
22312024-11-13T20:50:04.953ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49744
22322024-11-13T20:50:04.953ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49744 req_id = d9737129-e26f-4cac-a7cf-d20ba005beef response_code = 200 uri = /baseboard
22332024-11-13T20:50:13.343ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22342024-11-13T20:50:13.343ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
22352024-11-13T20:50:13.371ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1976, tv_nsec: 408636965 } time_to_next_cleanup = 599.99999758s
22362024-11-13T20:50:18.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65420
22372024-11-13T20:50:18.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65420 req_id = a2044929-e68a-44c1-888a-c79506b689d5 response_code = 200 uri = /vpc-routes
22382024-11-13T20:50:18.494ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
22392024-11-13T20:50:18.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65420 req_id = 8a7ebd65-25f3-4f42-b243-b5e6bd79fc4f response_code = 204 uri = /eip-gateways
22402024-11-13T20:50:18.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65420 req_id = 77be2464-9a69-4983-9f3c-02945504c215 response_code = 204 uri = /vpc-routes
22412024-11-13T20:50:18.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56089
22422024-11-13T20:50:18.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56089 req_id = 2e431bdb-b5a5-4a45-95b9-0423f092f7b9 response_code = 200 uri = /v2p
22432024-11-13T20:50:18.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40083
22442024-11-13T20:50:18.653ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22452024-11-13T20:50:18.691ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22462024-11-13T20:50:18.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100369 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40083 req_id = 14f0ba6a-69f2-4eb3-877a-37bdbb836a03 response_code = 204 uri = /switch-ports
22472024-11-13T20:50:18.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55677
22482024-11-13T20:50:18.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40083 req_id = 1230f4ba-1cee-45f7-aca7-6d4fe5d1206d response_code = 200 uri = /network-bootstore-config
22492024-11-13T20:50:18.754ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 75168899-d87d-49d2-8b98-d14f7b7eb489, kind: Service { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 }, name: Name("external-dns-c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a4ccb870-86a7-4151-a1d7-4db6b1a87752, kind: Service { id: a842ec92-0a47-4cf3-961b-d511caae6dde }, name: Name("external-dns-a842ec92-0a47-4cf3-961b-d511caae6dde"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a710b2c1-2d11-4fa8-853d-ebe0de1435fb, kind: Service { id: 40a99a76-55e2-4eca-9af8-34234c9027bd }, name: Name("nexus-40a99a76-55e2-4eca-9af8-34234c9027bd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc2e8e88-8497-4746-852d-c6030d315932, kind: Service { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc }, name: Name("nexus-29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dcbb36eb-ec28-4758-b092-0592208645d7, kind: Service { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee }, name: Name("nexus-38f04d99-7fed-47a2-afac-5c2bf6458bee"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 152])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22502024-11-13T20:50:18.754ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22512024-11-13T20:50:18.754ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22522024-11-13T20:50:18.754ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22532024-11-13T20:50:18.754ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22542024-11-13T20:50:18.754ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22552024-11-13T20:50:18.754ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22562024-11-13T20:50:18.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 384 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55677 req_id = c82f4f06-2815-4497-8f47-712ee771b55e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22572024-11-13T20:50:19.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56546
22582024-11-13T20:50:19.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56546 req_id = e778a1d1-4232-4182-81d1-a46de7954ca7 response_code = 200 uri = /vpc-routes
22592024-11-13T20:50:19.313ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
22602024-11-13T20:50:19.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56546 req_id = 4c67e0fc-bfef-440d-bb0d-c9a8a867b473 response_code = 204 uri = /eip-gateways
22612024-11-13T20:50:19.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56546 req_id = 31c34b6e-deee-48c0-b5fa-7abbc17d07fc response_code = 204 uri = /vpc-routes
22622024-11-13T20:50:19.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44156
22632024-11-13T20:50:19.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44156 req_id = 458bff45-b049-40ca-8650-68cedd89cd7f response_code = 200 uri = /v2p
22642024-11-13T20:50:19.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51582
22652024-11-13T20:50:19.602ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22662024-11-13T20:50:19.644ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22672024-11-13T20:50:19.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99958 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51582 req_id = 871d7e29-9113-43e8-a34d-376acc8d3662 response_code = 204 uri = /switch-ports
22682024-11-13T20:50:19.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61721
22692024-11-13T20:50:19.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45679
22702024-11-13T20:50:19.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45679 req_id = 0b712970-3c84-4244-9b26-d2a279653103 response_code = 200 uri = /vpc-routes
22712024-11-13T20:50:19.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51582 req_id = 9e423b07-7422-447c-b3e6-74775c897ddd response_code = 200 uri = /network-bootstore-config
22722024-11-13T20:50:19.702ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 75168899-d87d-49d2-8b98-d14f7b7eb489, kind: Service { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 }, name: Name("external-dns-c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a4ccb870-86a7-4151-a1d7-4db6b1a87752, kind: Service { id: a842ec92-0a47-4cf3-961b-d511caae6dde }, name: Name("external-dns-a842ec92-0a47-4cf3-961b-d511caae6dde"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a710b2c1-2d11-4fa8-853d-ebe0de1435fb, kind: Service { id: 40a99a76-55e2-4eca-9af8-34234c9027bd }, name: Name("nexus-40a99a76-55e2-4eca-9af8-34234c9027bd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc2e8e88-8497-4746-852d-c6030d315932, kind: Service { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc }, name: Name("nexus-29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dcbb36eb-ec28-4758-b092-0592208645d7, kind: Service { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee }, name: Name("nexus-38f04d99-7fed-47a2-afac-5c2bf6458bee"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 152])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22732024-11-13T20:50:19.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22742024-11-13T20:50:19.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22752024-11-13T20:50:19.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22762024-11-13T20:50:19.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22772024-11-13T20:50:19.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22782024-11-13T20:50:19.703ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22792024-11-13T20:50:19.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61721 req_id = 7d854c91-9827-4430-adaa-62d441b33be2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22802024-11-13T20:50:19.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50075
22812024-11-13T20:50:19.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50075 req_id = 12aacd25-3422-4f3b-9719-dc664362a8c9 response_code = 200 uri = /v2p
22822024-11-13T20:50:19.816ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
22832024-11-13T20:50:19.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45679 req_id = a737a65d-5abe-42a2-82c3-594c679137fe response_code = 204 uri = /eip-gateways
22842024-11-13T20:50:19.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45679 req_id = 606d0046-7ebd-4af2-865d-69f9e15623b6 response_code = 204 uri = /vpc-routes
22852024-11-13T20:50:19.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55628
22862024-11-13T20:50:19.892ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22872024-11-13T20:50:19.933ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22882024-11-13T20:50:19.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99683 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55628 req_id = 42ed3846-d1b1-428f-8eca-96c03dee597e response_code = 204 uri = /switch-ports
22892024-11-13T20:50:19.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60023
22902024-11-13T20:50:19.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55628 req_id = 1807ec54-a21e-4d9b-97ea-5e5e46f6ec46 response_code = 200 uri = /network-bootstore-config
22912024-11-13T20:50:19.992ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 75168899-d87d-49d2-8b98-d14f7b7eb489, kind: Service { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 }, name: Name("external-dns-c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a4ccb870-86a7-4151-a1d7-4db6b1a87752, kind: Service { id: a842ec92-0a47-4cf3-961b-d511caae6dde }, name: Name("external-dns-a842ec92-0a47-4cf3-961b-d511caae6dde"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a710b2c1-2d11-4fa8-853d-ebe0de1435fb, kind: Service { id: 40a99a76-55e2-4eca-9af8-34234c9027bd }, name: Name("nexus-40a99a76-55e2-4eca-9af8-34234c9027bd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc2e8e88-8497-4746-852d-c6030d315932, kind: Service { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc }, name: Name("nexus-29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dcbb36eb-ec28-4758-b092-0592208645d7, kind: Service { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee }, name: Name("nexus-38f04d99-7fed-47a2-afac-5c2bf6458bee"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 152])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22922024-11-13T20:50:19.992ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22932024-11-13T20:50:19.992ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22942024-11-13T20:50:19.992ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22952024-11-13T20:50:19.992ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22962024-11-13T20:50:19.992ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22972024-11-13T20:50:19.992ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22982024-11-13T20:50:19.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 391 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60023 req_id = f79e31a6-b370-4362-82de-a99692504748 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22992024-11-13T20:50:27.652ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23002024-11-13T20:50:34.985ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62917
23012024-11-13T20:50:34.985ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62917 req_id = f1e42d15-4f9c-491d-aaeb-edfc2ab5c7c3 response_code = 200 uri = /baseboard
23022024-11-13T20:50:48.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38584
23032024-11-13T20:50:48.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38584 req_id = e1b0aa62-5475-469c-a8de-47243885275a response_code = 200 uri = /vpc-routes
23042024-11-13T20:50:48.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
23052024-11-13T20:50:48.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38584 req_id = e9352bf0-1444-4b15-88fd-3b4bf9b0fe96 response_code = 204 uri = /eip-gateways
23062024-11-13T20:50:48.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38584 req_id = 514ee311-6595-40f6-aa0e-fecdeac4a92f response_code = 204 uri = /vpc-routes
23072024-11-13T20:50:48.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59910
23082024-11-13T20:50:48.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59910 req_id = 5ee5ce29-7d5e-40e9-b967-924fa4731c1c response_code = 200 uri = /v2p
23092024-11-13T20:50:48.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35345
23102024-11-13T20:50:48.407ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23112024-11-13T20:50:48.446ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23122024-11-13T20:50:48.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96789 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35345 req_id = 837dbf38-e158-45d5-80d0-816fbc63b132 response_code = 204 uri = /switch-ports
23132024-11-13T20:50:48.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35345 req_id = 9aec3816-c764-42b9-b031-017c5c13f7e5 response_code = 200 uri = /network-bootstore-config
23142024-11-13T20:50:49.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40981
23152024-11-13T20:50:49.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40981 req_id = 7ab1f895-77d5-4d33-8c17-dc874aacf503 response_code = 200 uri = /vpc-routes
23162024-11-13T20:50:49.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33764
23172024-11-13T20:50:49.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33764 req_id = 098b118e-0b22-441f-adc4-a3808a1f3d77 response_code = 200 uri = /v2p
23182024-11-13T20:50:49.332ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
23192024-11-13T20:50:49.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40981 req_id = 6d8a9f63-0084-4181-898a-52065343e98f response_code = 204 uri = /eip-gateways
23202024-11-13T20:50:49.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40981 req_id = 627e6254-2a0e-4ef6-aa38-c1995b4e6d4e response_code = 204 uri = /vpc-routes
23212024-11-13T20:50:49.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48711
23222024-11-13T20:50:49.349ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23232024-11-13T20:50:49.387ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23242024-11-13T20:50:49.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101443 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48711 req_id = 944ff72b-f4ed-46af-b614-26f080a7cbae response_code = 204 uri = /switch-ports
23252024-11-13T20:50:49.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43501
23262024-11-13T20:50:49.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43501 req_id = 1052c94a-5d79-405f-9abf-d0f65d398eb2 response_code = 200 uri = /vpc-routes
23272024-11-13T20:50:49.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48711 req_id = 5a33643e-ce26-4e72-b47f-1af1f5b4beca response_code = 200 uri = /network-bootstore-config
23282024-11-13T20:50:49.464ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
23292024-11-13T20:50:49.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43501 req_id = f26d8870-7887-4e8f-a043-d025d3f11078 response_code = 204 uri = /eip-gateways
23302024-11-13T20:50:49.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58659
23312024-11-13T20:50:49.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58659 req_id = 04fd992b-55f0-4ef4-a36d-dbedb7e69cc3 response_code = 200 uri = /v2p
23322024-11-13T20:50:49.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43501 req_id = 17675df9-0002-41fa-b0b6-349a4a350709 response_code = 204 uri = /vpc-routes
23332024-11-13T20:50:49.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32890
23342024-11-13T20:50:49.562ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23352024-11-13T20:50:49.601ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23362024-11-13T20:50:49.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32890 req_id = a8a72480-503b-49b5-bad4-64f284bf60d7 response_code = 204 uri = /switch-ports
23372024-11-13T20:50:49.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32890 req_id = de1be907-3189-4eeb-a144-7bb6711d8a42 response_code = 200 uri = /network-bootstore-config
23382024-11-13T20:51:05.022ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57760
23392024-11-13T20:51:05.022ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57760 req_id = cee364fb-4093-4cd6-a321-c65c2e0a8ea2 response_code = 200 uri = /baseboard
23402024-11-13T20:51:18.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33526
23412024-11-13T20:51:18.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33526 req_id = c7ff844b-9199-4cec-8887-a4bd18740ba0 response_code = 200 uri = /vpc-routes
23422024-11-13T20:51:18.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35665
23432024-11-13T20:51:18.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35665 req_id = 89ad6c52-6dfc-4f3a-ae7e-49318a12b02e response_code = 200 uri = /v2p
23442024-11-13T20:51:18.476ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
23452024-11-13T20:51:18.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33526 req_id = 31976386-2b82-413e-b169-f0ef4e8bb747 response_code = 204 uri = /eip-gateways
23462024-11-13T20:51:18.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33526 req_id = eb547085-bbf4-4e5b-91e3-bff015b4fa5b response_code = 204 uri = /vpc-routes
23472024-11-13T20:51:18.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53315
23482024-11-13T20:51:18.637ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23492024-11-13T20:51:18.678ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23502024-11-13T20:51:18.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98362 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53315 req_id = 2948c00b-3811-4cad-ab69-f3267310cf94 response_code = 204 uri = /switch-ports
23512024-11-13T20:51:18.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53315 req_id = cf24b20e-9f73-4aad-847d-1d456fe123a7 response_code = 200 uri = /network-bootstore-config
23522024-11-13T20:51:19.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46892
23532024-11-13T20:51:19.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46892 req_id = 8b5ab933-c89f-46c9-8943-38db59a5cbe2 response_code = 200 uri = /vpc-routes
23542024-11-13T20:51:19.188ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
23552024-11-13T20:51:19.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46892 req_id = cf2a4b4d-eb55-47da-ba2a-8036bae62cbf response_code = 204 uri = /eip-gateways
23562024-11-13T20:51:19.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46892 req_id = 06d3376b-eac1-43dc-994d-eda1dc09bac2 response_code = 204 uri = /vpc-routes
23572024-11-13T20:51:19.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63452
23582024-11-13T20:51:19.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63452 req_id = 4a63845f-9c5b-4b00-ace9-8e7c393201f2 response_code = 200 uri = /v2p
23592024-11-13T20:51:19.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60220
23602024-11-13T20:51:19.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60220 req_id = a36afd2e-084c-4df8-a304-7f33719e4588 response_code = 200 uri = /vpc-routes
23612024-11-13T20:51:19.567ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
23622024-11-13T20:51:19.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60220 req_id = a8a1036e-2532-4abb-9d77-b87a64c57cdd response_code = 204 uri = /eip-gateways
23632024-11-13T20:51:19.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60220 req_id = 27a15972-722b-4d2e-80ad-3f8e45fbe91d response_code = 204 uri = /vpc-routes
23642024-11-13T20:51:19.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46199
23652024-11-13T20:51:19.604ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23662024-11-13T20:51:19.642ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23672024-11-13T20:51:19.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91967 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46199 req_id = 1bd030c2-567c-49d2-8f6f-188bcc002233 response_code = 204 uri = /switch-ports
23682024-11-13T20:51:19.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58919
23692024-11-13T20:51:19.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58919 req_id = f085bbd1-69fd-48a3-befe-a799f63d5d41 response_code = 200 uri = /v2p
23702024-11-13T20:51:19.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46199 req_id = 5d5cf476-87fd-4e83-af84-556010f06fed response_code = 200 uri = /network-bootstore-config
23712024-11-13T20:51:19.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41338
23722024-11-13T20:51:19.740ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23732024-11-13T20:51:19.779ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23742024-11-13T20:51:19.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96357 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41338 req_id = b07b2e61-d01e-4397-8286-892107f8010e response_code = 204 uri = /switch-ports
23752024-11-13T20:51:19.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41338 req_id = e7600c3e-af2d-4f34-9612-2dff00bcc913 response_code = 200 uri = /network-bootstore-config
23762024-11-13T20:51:35.055ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42802
23772024-11-13T20:51:35.056ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 63 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42802 req_id = 93d0b98c-416f-48f1-99ec-a363d1db6d3b response_code = 200 uri = /baseboard
23782024-11-13T20:51:48.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33877
23792024-11-13T20:51:48.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33877 req_id = 8178663d-9256-4c68-a986-45e6cd771b68 response_code = 200 uri = /vpc-routes
23802024-11-13T20:51:48.300ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
23812024-11-13T20:51:48.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33877 req_id = 94fe0ae5-63f4-44ad-8b6d-3be6dbae3e1c response_code = 204 uri = /eip-gateways
23822024-11-13T20:51:48.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58292
23832024-11-13T20:51:48.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58292 req_id = ead965be-9077-440e-8dc4-9d45a46aa0d1 response_code = 200 uri = /v2p
23842024-11-13T20:51:48.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33877 req_id = 97b36bb0-1117-4981-8e38-713efec23c8e response_code = 204 uri = /vpc-routes
23852024-11-13T20:51:48.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49557
23862024-11-13T20:51:48.385ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23872024-11-13T20:51:48.425ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23882024-11-13T20:51:48.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99585 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49557 req_id = 088aa86b-9d3c-4e50-810c-41a6b486244f response_code = 204 uri = /switch-ports
23892024-11-13T20:51:48.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49557 req_id = 4b4aaca7-0ab2-4053-a087-fdb13a77ee00 response_code = 200 uri = /network-bootstore-config
23902024-11-13T20:51:49.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61021
23912024-11-13T20:51:49.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61021 req_id = 52ec005f-d4cb-4baa-9e51-b620761f206f response_code = 200 uri = /vpc-routes
23922024-11-13T20:51:49.247ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
23932024-11-13T20:51:49.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61021 req_id = b14aaa4d-cbf5-44e5-a346-59ecc36f25e2 response_code = 204 uri = /eip-gateways
23942024-11-13T20:51:49.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57434
23952024-11-13T20:51:49.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57434 req_id = d07299a7-ec8f-4aef-b5b5-b3d8d07af756 response_code = 200 uri = /v2p
23962024-11-13T20:51:49.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61021 req_id = 4b2e71dd-4e9f-42ac-8b27-982881d52165 response_code = 204 uri = /vpc-routes
23972024-11-13T20:51:49.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38626
23982024-11-13T20:51:49.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38626 req_id = fa832ebb-9c4f-4cfc-95e9-834e0db70335 response_code = 200 uri = /vpc-routes
23992024-11-13T20:51:49.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57643
24002024-11-13T20:51:49.385ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24012024-11-13T20:51:49.429ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24022024-11-13T20:51:49.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106286 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57643 req_id = 8509310f-b10e-476a-87f4-99367f97c42d response_code = 204 uri = /switch-ports
24032024-11-13T20:51:49.492ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
24042024-11-13T20:51:49.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38626 req_id = f5d2667c-9dc0-4a64-a5a0-a8d35adb804b response_code = 204 uri = /eip-gateways
24052024-11-13T20:51:49.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57643 req_id = 1aa1e374-e6e7-4cb4-850d-2d270c2a57d1 response_code = 200 uri = /network-bootstore-config
24062024-11-13T20:51:49.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38626 req_id = b5fa6752-22a8-4af4-8dfe-3a28bf39f000 response_code = 204 uri = /vpc-routes
24072024-11-13T20:51:49.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64907
24082024-11-13T20:51:49.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64907 req_id = 7d058ade-c82c-4cdb-930a-fd0b1b8a3a66 response_code = 200 uri = /v2p
24092024-11-13T20:51:49.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62038
24102024-11-13T20:51:49.674ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24112024-11-13T20:51:49.716ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24122024-11-13T20:51:49.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100396 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62038 req_id = 82f8b602-a117-4cbc-9a2a-9c95a36421e9 response_code = 204 uri = /switch-ports
24132024-11-13T20:51:49.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62038 req_id = 414ee91c-8309-4351-90e6-ce6e6e126e82 response_code = 200 uri = /network-bootstore-config
24142024-11-13T20:52:05.088ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60296
24152024-11-13T20:52:05.088ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60296 req_id = 2635755e-4c48-44b0-b097-a077f64846da response_code = 200 uri = /baseboard
24162024-11-13T20:52:18.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45515
24172024-11-13T20:52:18.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45515 req_id = aa5c0423-b4c0-45ca-b1ff-436b26702ea7 response_code = 200 uri = /vpc-routes
24182024-11-13T20:52:18.319ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
24192024-11-13T20:52:18.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45515 req_id = 0168699c-343a-4c5e-a696-3c1ca1f69c87 response_code = 204 uri = /eip-gateways
24202024-11-13T20:52:18.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45515 req_id = f9800bac-ef04-44f6-a3ca-106122a5ffb4 response_code = 204 uri = /vpc-routes
24212024-11-13T20:52:18.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60475
24222024-11-13T20:52:18.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60475 req_id = 98fef7fc-7b70-4422-b3ea-5bcfe3f1e254 response_code = 200 uri = /v2p
24232024-11-13T20:52:18.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38678
24242024-11-13T20:52:18.590ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24252024-11-13T20:52:18.629ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24262024-11-13T20:52:18.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97671 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38678 req_id = a04d09cf-e20b-47f2-9bcd-1176d278c491 response_code = 204 uri = /switch-ports
24272024-11-13T20:52:18.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38678 req_id = 059306f8-6b41-4db3-8f6c-923f17848e90 response_code = 200 uri = /network-bootstore-config
24282024-11-13T20:52:19.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52286
24292024-11-13T20:52:19.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52286 req_id = 5a15cdf4-e3ca-4b1e-b305-2438c022a8e4 response_code = 200 uri = /vpc-routes
24302024-11-13T20:52:19.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48918
24312024-11-13T20:52:19.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48918 req_id = d24c5607-ec8e-437e-bea1-8852f91c0ede response_code = 200 uri = /v2p
24322024-11-13T20:52:19.394ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
24332024-11-13T20:52:19.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52286 req_id = 73568d4c-0a15-4ffe-83af-89582a98604c response_code = 204 uri = /eip-gateways
24342024-11-13T20:52:19.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52286 req_id = 3c6e985f-1c63-4fab-9d65-de1c97cb8f96 response_code = 204 uri = /vpc-routes
24352024-11-13T20:52:19.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55827
24362024-11-13T20:52:19.454ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24372024-11-13T20:52:19.496ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24382024-11-13T20:52:19.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101803 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55827 req_id = 14bb56fd-f4a8-4f9f-b2d9-873724db4bab response_code = 204 uri = /switch-ports
24392024-11-13T20:52:19.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55638
24402024-11-13T20:52:19.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55638 req_id = 530ea289-7abb-4f0a-acb4-5071e03fd277 response_code = 200 uri = /vpc-routes
24412024-11-13T20:52:19.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55827 req_id = 242f46ea-61f2-46eb-aee5-d1e056e1e602 response_code = 200 uri = /network-bootstore-config
24422024-11-13T20:52:19.596ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
24432024-11-13T20:52:19.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55638 req_id = 0e5bdd4f-eccd-480d-a1ff-8dbfee21f7cf response_code = 204 uri = /eip-gateways
24442024-11-13T20:52:19.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55638 req_id = daaba589-3343-4d23-9565-746be7b5eb54 response_code = 204 uri = /vpc-routes
24452024-11-13T20:52:19.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33901
24462024-11-13T20:52:19.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33901 req_id = fc55bed3-775c-4487-a90b-ab5b044d7de8 response_code = 200 uri = /v2p
24472024-11-13T20:52:19.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58555
24482024-11-13T20:52:19.855ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24492024-11-13T20:52:19.896ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24502024-11-13T20:52:19.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100597 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58555 req_id = 9910bb8e-3abc-4413-b4fb-3230739b16e2 response_code = 204 uri = /switch-ports
24512024-11-13T20:52:19.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58555 req_id = bee5d280-8b68-4a24-bcda-19a317aa1e94 response_code = 200 uri = /network-bootstore-config
24522024-11-13T20:52:35.121ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50198
24532024-11-13T20:52:35.122ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50198 req_id = cecf1cf7-c5a9-40f3-84e4-8628bd11a1aa response_code = 200 uri = /baseboard
24542024-11-13T20:52:40.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = b6e177bd-5357-4f01-b047-206109321c43
24552024-11-13T20:52:40.905ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = b6e177bd-5357-4f01-b047-206109321c43
24562024-11-13T20:52:48.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38723
24572024-11-13T20:52:48.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38723 req_id = 583b046e-28b8-436c-893a-97cc7e81bd80 response_code = 200 uri = /vpc-routes
24582024-11-13T20:52:48.389ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
24592024-11-13T20:52:48.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38723 req_id = 099e9218-7aec-49f3-900a-0a400ca30ea3 response_code = 204 uri = /eip-gateways
24602024-11-13T20:52:48.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38723 req_id = 802bb97d-57c5-4ce3-a027-fce60c7a1534 response_code = 204 uri = /vpc-routes
24612024-11-13T20:52:48.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41262
24622024-11-13T20:52:48.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41262 req_id = 49b56143-ee57-4fce-9cce-d22f3ec4ad85 response_code = 200 uri = /v2p
24632024-11-13T20:52:48.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58596
24642024-11-13T20:52:48.451ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24652024-11-13T20:52:48.490ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24662024-11-13T20:52:48.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96893 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58596 req_id = 8f226ad6-e5d1-427d-b862-1aa6996004a7 response_code = 204 uri = /switch-ports
24672024-11-13T20:52:48.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58596 req_id = 413f1f52-e6fa-411d-ae54-82bf38e59578 response_code = 200 uri = /network-bootstore-config
24682024-11-13T20:52:49.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52539
24692024-11-13T20:52:49.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52539 req_id = b3044e57-d87d-4f0f-90e7-ed9ec5d29c29 response_code = 200 uri = /vpc-routes
24702024-11-13T20:52:49.132ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
24712024-11-13T20:52:49.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52539 req_id = c47dcb84-48f4-4c75-a267-1306deb02b66 response_code = 204 uri = /eip-gateways
24722024-11-13T20:52:49.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52539 req_id = 24ec6d6d-2617-402e-bcca-5d3783ebff4e response_code = 204 uri = /vpc-routes
24732024-11-13T20:52:49.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33712
24742024-11-13T20:52:49.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33712 req_id = 30fa9a5a-f97a-4d6b-9ccb-ecab502dad55 response_code = 200 uri = /v2p
24752024-11-13T20:52:49.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51029
24762024-11-13T20:52:49.400ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24772024-11-13T20:52:49.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24782024-11-13T20:52:49.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101903 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51029 req_id = 68c8ce9b-160d-4af2-a525-5187384a6e17 response_code = 204 uri = /switch-ports
24792024-11-13T20:52:49.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54719
24802024-11-13T20:52:49.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54719 req_id = 748e946a-1f00-42fe-84c8-b6e92f6f3626 response_code = 200 uri = /vpc-routes
24812024-11-13T20:52:49.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51029 req_id = a2c56d82-e6c4-4802-b836-0f24b10c1527 response_code = 200 uri = /network-bootstore-config
24822024-11-13T20:52:49.518ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
24832024-11-13T20:52:49.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54719 req_id = f301c920-261d-447f-ab72-1417dda03cb3 response_code = 204 uri = /eip-gateways
24842024-11-13T20:52:49.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54719 req_id = 237e5316-68c3-4912-98b4-57d3add0b179 response_code = 204 uri = /vpc-routes
24852024-11-13T20:52:49.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61145
24862024-11-13T20:52:49.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61145 req_id = d3db30f2-fd29-427f-989d-850463ab145c response_code = 200 uri = /v2p
24872024-11-13T20:52:49.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33564
24882024-11-13T20:52:49.576ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24892024-11-13T20:52:49.614ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24902024-11-13T20:52:49.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96217 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33564 req_id = f8c4e867-e781-4126-90dd-256f03b791d6 response_code = 204 uri = /switch-ports
24912024-11-13T20:52:49.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33564 req_id = defc9cd6-3b9f-4c23-8098-9aacb2e6a396 response_code = 200 uri = /network-bootstore-config
24922024-11-13T20:52:50.904ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
24932024-11-13T20:52:50.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
24942024-11-13T20:52:50.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
24952024-11-13T20:52:50.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
24962024-11-13T20:53:00.906ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
24972024-11-13T20:53:00.908ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
24982024-11-13T20:53:00.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
24992024-11-13T20:53:00.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25002024-11-13T20:53:05.155ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59773
25012024-11-13T20:53:05.155ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59773 req_id = 8ce2ba24-645c-4fb4-aa77-b53135ad6c41 response_code = 200 uri = /baseboard
25022024-11-13T20:53:10.907ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25032024-11-13T20:53:10.910ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25042024-11-13T20:53:10.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25052024-11-13T20:53:10.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25062024-11-13T20:53:18.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58223
25072024-11-13T20:53:18.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58223 req_id = 575cb201-a89f-4796-82d6-52cba2c62b3d response_code = 200 uri = /vpc-routes
25082024-11-13T20:53:18.250ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
25092024-11-13T20:53:18.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58223 req_id = 5c644a9e-92fe-48f3-bd69-2869559a35c0 response_code = 204 uri = /eip-gateways
25102024-11-13T20:53:18.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58223 req_id = 0b290462-a857-4c05-9f10-32fa094441d4 response_code = 204 uri = /vpc-routes
25112024-11-13T20:53:18.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42345
25122024-11-13T20:53:18.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42345 req_id = 403b83be-4f22-43bf-b08b-5aa53db096bd response_code = 200 uri = /v2p
25132024-11-13T20:53:18.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58385
25142024-11-13T20:53:18.579ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25152024-11-13T20:53:18.617ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25162024-11-13T20:53:18.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100392 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58385 req_id = 35efcbc2-eb9f-46a9-88e4-e78b9a0c98f9 response_code = 204 uri = /switch-ports
25172024-11-13T20:53:18.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58385 req_id = af1e4115-52c0-43c4-afe4-4c72e8b0b505 response_code = 200 uri = /network-bootstore-config
25182024-11-13T20:53:19.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36514
25192024-11-13T20:53:19.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36514 req_id = 620481f0-23d7-4816-a9c1-8a1374e3692e response_code = 200 uri = /v2p
25202024-11-13T20:53:19.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41860
25212024-11-13T20:53:19.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41860 req_id = 22e6a9ad-1ce3-4a15-8841-9a4e21d94dbb response_code = 200 uri = /vpc-routes
25222024-11-13T20:53:19.387ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
25232024-11-13T20:53:19.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41860 req_id = cddfd357-9999-424a-ba01-d9b0aeefc325 response_code = 204 uri = /eip-gateways
25242024-11-13T20:53:19.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41860 req_id = 5d675654-1d6a-4ec0-9f9f-117b5613b309 response_code = 204 uri = /vpc-routes
25252024-11-13T20:53:19.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49039
25262024-11-13T20:53:19.452ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25272024-11-13T20:53:19.496ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25282024-11-13T20:53:19.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104586 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49039 req_id = b97c18f9-2216-45f6-80ee-8aa79f7bf2e3 response_code = 204 uri = /switch-ports
25292024-11-13T20:53:19.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49039 req_id = 61bc0c70-7ab6-483d-bd0a-c0069e254cea response_code = 200 uri = /network-bootstore-config
25302024-11-13T20:53:19.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64609
25312024-11-13T20:53:19.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64609 req_id = 19d3a3fa-89ee-45ea-b62b-bcd928c4aeee response_code = 200 uri = /vpc-routes
25322024-11-13T20:53:19.710ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
25332024-11-13T20:53:19.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64609 req_id = 54b3e998-be49-4c85-ba85-4bbdc1c4cb46 response_code = 204 uri = /eip-gateways
25342024-11-13T20:53:19.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64609 req_id = 5a06616b-067c-40ba-b050-e3b9497d65fa response_code = 204 uri = /vpc-routes
25352024-11-13T20:53:19.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58345
25362024-11-13T20:53:19.761ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25372024-11-13T20:53:19.802ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25382024-11-13T20:53:19.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58345 req_id = 05d3d1d8-3da1-4440-9431-d6f93ad36867 response_code = 204 uri = /switch-ports
25392024-11-13T20:53:19.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34369
25402024-11-13T20:53:19.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34369 req_id = bdd878a8-da56-406a-882c-4d0f2f6e9f70 response_code = 200 uri = /v2p
25412024-11-13T20:53:19.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58345 req_id = 83998ea8-2334-4421-b073-f6b0052fcd98 response_code = 200 uri = /network-bootstore-config
25422024-11-13T20:53:20.909ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25432024-11-13T20:53:20.912ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25442024-11-13T20:53:20.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25452024-11-13T20:53:20.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25462024-11-13T20:53:30.911ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25472024-11-13T20:53:30.914ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25482024-11-13T20:53:30.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25492024-11-13T20:53:30.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25502024-11-13T20:53:35.189ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39350
25512024-11-13T20:53:35.189ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39350 req_id = 2161509d-52ea-4f4b-863a-46b683cf0d90 response_code = 200 uri = /baseboard
25522024-11-13T20:53:40.913ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25532024-11-13T20:53:40.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25542024-11-13T20:53:40.917ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25552024-11-13T20:53:40.918ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25562024-11-13T20:53:48.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52404
25572024-11-13T20:53:48.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52404 req_id = e4cd5dd6-bf02-4a67-8d08-4318727e48b7 response_code = 200 uri = /vpc-routes
25582024-11-13T20:53:48.340ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
25592024-11-13T20:53:48.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52404 req_id = ba38bcb2-a42e-4f7a-a130-87960df5f24c response_code = 204 uri = /eip-gateways
25602024-11-13T20:53:48.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52404 req_id = 06723617-dcbe-4798-814e-0f40800dae85 response_code = 204 uri = /vpc-routes
25612024-11-13T20:53:48.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47255
25622024-11-13T20:53:48.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47255 req_id = 484c2f85-d6fe-4d0e-be34-e54c2b1cc8cc response_code = 200 uri = /v2p
25632024-11-13T20:53:48.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61430
25642024-11-13T20:53:48.402ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25652024-11-13T20:53:48.442ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25662024-11-13T20:53:48.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100402 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61430 req_id = ef46419d-caab-46d7-a8d5-5f44b35f9a03 response_code = 204 uri = /switch-ports
25672024-11-13T20:53:48.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61430 req_id = 4f967e45-d21d-434c-a613-c03d6d0337dd response_code = 200 uri = /network-bootstore-config
25682024-11-13T20:53:49.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39232
25692024-11-13T20:53:49.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39232 req_id = cae460a6-0723-4e63-8ed7-e60a161ead92 response_code = 200 uri = /vpc-routes
25702024-11-13T20:53:49.173ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
25712024-11-13T20:53:49.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39232 req_id = 94226f6e-217a-4268-b5b8-654a98969783 response_code = 204 uri = /eip-gateways
25722024-11-13T20:53:49.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39232 req_id = 6542d8a8-3320-44cf-8173-5a1a5e3b6efe response_code = 204 uri = /vpc-routes
25732024-11-13T20:53:49.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38887
25742024-11-13T20:53:49.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25752024-11-13T20:53:49.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25762024-11-13T20:53:49.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115280 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38887 req_id = 3b61dc44-881e-42ff-ad82-f3eb33f64c39 response_code = 204 uri = /switch-ports
25772024-11-13T20:53:49.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40737
25782024-11-13T20:53:49.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34617
25792024-11-13T20:53:49.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38887 req_id = fd2f9be4-49e2-405b-8700-87386391786b response_code = 200 uri = /network-bootstore-config
25802024-11-13T20:53:49.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34617 req_id = 370d24cd-0af0-49ba-ad6d-c4f4b81ddcaf response_code = 200 uri = /vpc-routes
25812024-11-13T20:53:49.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40737 req_id = c41930e6-e69a-4bae-8e77-994eef698676 response_code = 200 uri = /v2p
25822024-11-13T20:53:49.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
25832024-11-13T20:53:49.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34617 req_id = 29212203-754c-433a-a7d1-725ac9bfbb0e response_code = 204 uri = /eip-gateways
25842024-11-13T20:53:49.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34617 req_id = 9e3d0d4f-6d02-4ac2-89a7-b66f5b0855a0 response_code = 204 uri = /vpc-routes
25852024-11-13T20:53:49.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54631
25862024-11-13T20:53:49.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54631 req_id = 2b14f0ee-20da-40d2-bb76-5b6d8300d47d response_code = 200 uri = /v2p
25872024-11-13T20:53:49.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63909
25882024-11-13T20:53:49.429ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25892024-11-13T20:53:49.466ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25902024-11-13T20:53:49.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91327 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63909 req_id = 981999b3-9dab-41f3-8115-50be1815b954 response_code = 204 uri = /switch-ports
25912024-11-13T20:53:49.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63909 req_id = 7dd3be27-3539-4923-b57f-a0bee6a32e71 response_code = 200 uri = /network-bootstore-config
25922024-11-13T20:53:50.915ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25932024-11-13T20:53:50.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25942024-11-13T20:53:50.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25952024-11-13T20:53:50.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25962024-11-13T20:54:00.916ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25972024-11-13T20:54:00.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25982024-11-13T20:54:00.921ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
25992024-11-13T20:54:00.922ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26002024-11-13T20:54:05.226ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64693
26012024-11-13T20:54:05.226ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64693 req_id = ba422b61-9416-473a-bfe3-2cea36938f09 response_code = 200 uri = /baseboard
26022024-11-13T20:54:10.919ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26032024-11-13T20:54:10.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26042024-11-13T20:54:10.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26052024-11-13T20:54:10.924ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26062024-11-13T20:54:18.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40328
26072024-11-13T20:54:18.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40328 req_id = dfa5aeac-f988-42c8-9fdb-e86da10c8cde response_code = 200 uri = /vpc-routes
26082024-11-13T20:54:18.418ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
26092024-11-13T20:54:18.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40328 req_id = bbb78737-9484-4401-8a88-a9ca31b420cf response_code = 204 uri = /eip-gateways
26102024-11-13T20:54:18.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40328 req_id = 1d0af9b1-adad-4558-a961-600126fd5114 response_code = 204 uri = /vpc-routes
26112024-11-13T20:54:18.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53397
26122024-11-13T20:54:18.502ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26132024-11-13T20:54:18.543ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26142024-11-13T20:54:18.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53397 req_id = 7d22718e-5a76-463f-a0ac-39ef1d5c7b9d response_code = 204 uri = /switch-ports
26152024-11-13T20:54:18.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54139
26162024-11-13T20:54:18.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53397 req_id = 52feb696-aaea-4321-b9c4-17cf8c11d485 response_code = 200 uri = /network-bootstore-config
26172024-11-13T20:54:18.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54139 req_id = c45fce81-360f-4ad8-8d58-8327ba178853 response_code = 200 uri = /v2p
26182024-11-13T20:54:19.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33245
26192024-11-13T20:54:19.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33245 req_id = d804ccdf-7bf5-4fa9-b9ca-05fac7423257 response_code = 200 uri = /vpc-routes
26202024-11-13T20:54:19.313ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
26212024-11-13T20:54:19.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33245 req_id = e6bf858b-c58a-49ea-9c9d-0f2fbef2555a response_code = 204 uri = /eip-gateways
26222024-11-13T20:54:19.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33245 req_id = e9a0076a-b537-4793-a3fe-a5de7395c516 response_code = 204 uri = /vpc-routes
26232024-11-13T20:54:19.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63994
26242024-11-13T20:54:19.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63994 req_id = d27d22da-e111-40e3-92a5-561880d0dba7 response_code = 200 uri = /v2p
26252024-11-13T20:54:19.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37781
26262024-11-13T20:54:19.424ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26272024-11-13T20:54:19.468ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26282024-11-13T20:54:19.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105860 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37781 req_id = ca640757-eee7-4fad-ba89-51fa09224e53 response_code = 204 uri = /switch-ports
26292024-11-13T20:54:19.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51281
26302024-11-13T20:54:19.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51281 req_id = 91293773-1668-495e-a939-1af7d2b730de response_code = 200 uri = /vpc-routes
26312024-11-13T20:54:19.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37781 req_id = a8701f8f-4b73-48a7-93a5-4ce8d2b4ef09 response_code = 200 uri = /network-bootstore-config
26322024-11-13T20:54:19.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53720
26332024-11-13T20:54:19.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53720 req_id = b77fa81c-d369-4534-b77e-799ecd6780fc response_code = 200 uri = /v2p
26342024-11-13T20:54:19.622ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
26352024-11-13T20:54:19.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51281 req_id = d047f811-1c9f-46a7-a9a4-d9abe3ba2764 response_code = 204 uri = /eip-gateways
26362024-11-13T20:54:19.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51281 req_id = 2c3c33e9-bf57-4b3f-b7c5-47c9bf36a7d5 response_code = 204 uri = /vpc-routes
26372024-11-13T20:54:19.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41953
26382024-11-13T20:54:19.709ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26392024-11-13T20:54:19.751ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26402024-11-13T20:54:19.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101827 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41953 req_id = 5c6c3324-480b-49f1-b882-0df934ca777e response_code = 204 uri = /switch-ports
26412024-11-13T20:54:19.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41953 req_id = 8dde5f8f-cbf6-444f-9ae9-8582fc8c24ec response_code = 200 uri = /network-bootstore-config
26422024-11-13T20:54:20.920ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26432024-11-13T20:54:20.924ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26442024-11-13T20:54:20.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26452024-11-13T20:54:20.926ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26462024-11-13T20:54:30.923ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26472024-11-13T20:54:30.926ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26482024-11-13T20:54:30.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26492024-11-13T20:54:30.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26502024-11-13T20:54:35.262ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38720
26512024-11-13T20:54:35.263ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38720 req_id = c9cad4be-6d0b-40b4-9435-a85295b245c4 response_code = 200 uri = /baseboard
26522024-11-13T20:54:40.925ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26532024-11-13T20:54:40.927ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26542024-11-13T20:54:40.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26552024-11-13T20:54:40.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26562024-11-13T20:54:48.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38181
26572024-11-13T20:54:48.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38181 req_id = cc76ceba-2ab9-487e-b9d6-235aef269f9c response_code = 200 uri = /vpc-routes
26582024-11-13T20:54:48.307ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
26592024-11-13T20:54:48.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38181 req_id = 59fe181a-0e1b-4795-8231-4ae1f0eb345c response_code = 204 uri = /eip-gateways
26602024-11-13T20:54:48.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38181 req_id = 79dd06e0-fefe-497d-a2d2-c64f7acdcc3a response_code = 204 uri = /vpc-routes
26612024-11-13T20:54:48.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42316
26622024-11-13T20:54:48.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42316 req_id = c0e940aa-c565-48d0-8cea-49ff28358c45 response_code = 200 uri = /v2p
26632024-11-13T20:54:48.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62668
26642024-11-13T20:54:48.355ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26652024-11-13T20:54:48.397ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26662024-11-13T20:54:48.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104451 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62668 req_id = c6a17430-6e08-47f6-8206-951aaed77c6b response_code = 204 uri = /switch-ports
26672024-11-13T20:54:48.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62668 req_id = 3d196906-8799-4744-8104-c55a16ee3c15 response_code = 200 uri = /network-bootstore-config
26682024-11-13T20:54:49.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59804
26692024-11-13T20:54:49.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59804 req_id = 3a844029-5cb6-4d30-954f-a9f72c1e107b response_code = 200 uri = /v2p
26702024-11-13T20:54:49.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58106
26712024-11-13T20:54:49.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58106 req_id = 4c348b99-ca87-4aee-b43e-9b48fbfd9a45 response_code = 200 uri = /vpc-routes
26722024-11-13T20:54:49.309ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
26732024-11-13T20:54:49.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58106 req_id = 2061807e-a6ce-44f9-9659-307959d6cc6f response_code = 204 uri = /eip-gateways
26742024-11-13T20:54:49.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58106 req_id = 5b1a4975-5788-40a9-8f46-009e5a8f49c3 response_code = 204 uri = /vpc-routes
26752024-11-13T20:54:49.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50536
26762024-11-13T20:54:49.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26772024-11-13T20:54:49.374ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26782024-11-13T20:54:49.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103760 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50536 req_id = 797d45ed-c75a-4383-9492-f024ef285bc2 response_code = 204 uri = /switch-ports
26792024-11-13T20:54:49.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46760
26802024-11-13T20:54:49.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46760 req_id = db04fba5-e9b4-43ac-b0bf-9b9d6e2cfbbe response_code = 200 uri = /vpc-routes
26812024-11-13T20:54:49.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50536 req_id = 2cbd13fa-f51b-4eab-a6b9-61158f5bce16 response_code = 200 uri = /network-bootstore-config
26822024-11-13T20:54:49.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
26832024-11-13T20:54:49.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46760 req_id = cf3d323f-c408-47f6-917b-4710d1f8f37a response_code = 204 uri = /eip-gateways
26842024-11-13T20:54:49.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60924
26852024-11-13T20:54:49.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60924 req_id = 08fbf5ba-2ab9-4b26-b85d-3b40016a375a response_code = 200 uri = /v2p
26862024-11-13T20:54:49.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46760 req_id = 29eead9c-c5cc-4cd1-a926-30f36856f0b0 response_code = 204 uri = /vpc-routes
26872024-11-13T20:54:49.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56125
26882024-11-13T20:54:49.516ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26892024-11-13T20:54:49.555ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26902024-11-13T20:54:49.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95941 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56125 req_id = 6e77587c-f624-453b-b06d-842a26f68f2b response_code = 204 uri = /switch-ports
26912024-11-13T20:54:49.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56125 req_id = fafc698d-73a7-407d-bb1e-f139a29eb67c response_code = 200 uri = /network-bootstore-config
26922024-11-13T20:54:50.928ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26932024-11-13T20:54:50.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26942024-11-13T20:54:50.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26952024-11-13T20:54:50.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26962024-11-13T20:55:00.929ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26972024-11-13T20:55:00.930ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26982024-11-13T20:55:00.932ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
26992024-11-13T20:55:00.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
27002024-11-13T20:55:05.300ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44915
27012024-11-13T20:55:05.300ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44915 req_id = 190b1d4d-e233-42f4-bfd8-80aec0227161 response_code = 200 uri = /baseboard
27022024-11-13T20:55:10.931ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
27032024-11-13T20:55:10.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
27042024-11-13T20:55:10.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
27052024-11-13T20:55:10.934ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
27062024-11-13T20:55:18.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58925
27072024-11-13T20:55:18.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58925 req_id = 0e234075-f6bd-4a88-a4ea-72592b82919e response_code = 200 uri = /vpc-routes
27082024-11-13T20:55:18.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
27092024-11-13T20:55:18.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58925 req_id = 287ad939-88e4-499b-807e-f20b52841c29 response_code = 204 uri = /eip-gateways
27102024-11-13T20:55:18.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33035
27112024-11-13T20:55:18.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33035 req_id = 7d6cf205-651d-4c80-b3ee-fd5820ad3e80 response_code = 200 uri = /v2p
27122024-11-13T20:55:18.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58925 req_id = 56fabd89-4328-48c6-9689-9322770aeef5 response_code = 204 uri = /vpc-routes
27132024-11-13T20:55:18.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37104
27142024-11-13T20:55:18.783ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27152024-11-13T20:55:18.826ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27162024-11-13T20:55:18.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107175 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37104 req_id = 6b240f81-67c6-44f1-8ef4-7199a534e2cd response_code = 204 uri = /switch-ports
27172024-11-13T20:55:18.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57894
27182024-11-13T20:55:18.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27192024-11-13T20:55:18.891ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27202024-11-13T20:55:18.891ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:177
27212024-11-13T20:55:18.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37104 req_id = 0a7bd8f6-b3b5-408b-b0be-122316b3ff11 response_code = 200 uri = /network-bootstore-config
27222024-11-13T20:55:18.892ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:177
27232024-11-13T20:55:18.905ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27242024-11-13T20:55:18.905ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_668784d0-9ec9-43d5-800e-a1a6d097030c
27252024-11-13T20:55:18.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51906
27262024-11-13T20:55:18.913ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 75168899-d87d-49d2-8b98-d14f7b7eb489, kind: Service { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 }, name: Name("external-dns-c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a4ccb870-86a7-4151-a1d7-4db6b1a87752, kind: Service { id: a842ec92-0a47-4cf3-961b-d511caae6dde }, name: Name("external-dns-a842ec92-0a47-4cf3-961b-d511caae6dde"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a710b2c1-2d11-4fa8-853d-ebe0de1435fb, kind: Service { id: 40a99a76-55e2-4eca-9af8-34234c9027bd }, name: Name("nexus-40a99a76-55e2-4eca-9af8-34234c9027bd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc2e8e88-8497-4746-852d-c6030d315932, kind: Service { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc }, name: Name("nexus-29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dcbb36eb-ec28-4758-b092-0592208645d7, kind: Service { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee }, name: Name("nexus-38f04d99-7fed-47a2-afac-5c2bf6458bee"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 152])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27272024-11-13T20:55:18.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27282024-11-13T20:55:18.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27292024-11-13T20:55:18.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27302024-11-13T20:55:18.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27312024-11-13T20:55:18.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27322024-11-13T20:55:18.913ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27332024-11-13T20:55:18.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51906 req_id = 1a9b2f74-5607-48e2-87b0-3125e0282b1b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27342024-11-13T20:55:18.930ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27352024-11-13T20:55:18.930ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e43f0729-982f-4960-b10a-7966152ae48a
27362024-11-13T20:55:18.955ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27372024-11-13T20:55:18.955ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_94d47f77-b938-4683-89de-401156b9868f
27382024-11-13T20:55:19.002ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27392024-11-13T20:55:19.002ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8
27402024-11-13T20:55:19.029ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27412024-11-13T20:55:19.030ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b
27422024-11-13T20:55:19.051ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27432024-11-13T20:55:19.052ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2c90aa03-5691-4147-8289-5741cd7b19ba
27442024-11-13T20:55:19.076ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27452024-11-13T20:55:19.076ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_df67e3ea-c363-421d-9d4f-d05175051931
27462024-11-13T20:55:19.098ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27472024-11-13T20:55:19.098ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2
27482024-11-13T20:55:19.118ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27492024-11-13T20:55:19.118ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828
27502024-11-13T20:55:19.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 239641 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57894 req_id = 22095934-e3e7-4db4-bef7-197175aefd91 response_code = 200 uri = /inventory
27512024-11-13T20:55:19.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54101
27522024-11-13T20:55:19.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54101 req_id = 293f3319-b93b-4894-8c86-a6f3cb1959b5 response_code = 200 uri = /vpc-routes
27532024-11-13T20:55:19.424ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
27542024-11-13T20:55:19.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54101 req_id = bc3cdf6e-be99-4758-80d2-9bccf8cc944d response_code = 204 uri = /eip-gateways
27552024-11-13T20:55:19.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54101 req_id = 591b645a-0448-40d6-a169-b978923e7c8a response_code = 204 uri = /vpc-routes
27562024-11-13T20:55:19.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63852
27572024-11-13T20:55:19.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63852 req_id = e56989a7-7146-4d9b-8fb5-5a9bdec3b573 response_code = 200 uri = /vpc-routes
27582024-11-13T20:55:19.544ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
27592024-11-13T20:55:19.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63852 req_id = 45dfaadf-a50f-4298-9d4e-6b9343d05ad6 response_code = 204 uri = /eip-gateways
27602024-11-13T20:55:19.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63852 req_id = 69898d73-9d50-45c4-8217-336873029671 response_code = 204 uri = /vpc-routes
27612024-11-13T20:55:19.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50660
27622024-11-13T20:55:19.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27632024-11-13T20:55:19.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27642024-11-13T20:55:19.581ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:177
27652024-11-13T20:55:19.582ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:177
27662024-11-13T20:55:19.596ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27672024-11-13T20:55:19.596ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_668784d0-9ec9-43d5-800e-a1a6d097030c
27682024-11-13T20:55:19.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58219
27692024-11-13T20:55:19.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58219 req_id = 948f0be5-8ae5-47d1-bcde-ea2203352edf response_code = 200 uri = /v2p
27702024-11-13T20:55:19.625ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27712024-11-13T20:55:19.625ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e43f0729-982f-4960-b10a-7966152ae48a
27722024-11-13T20:55:19.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60715
27732024-11-13T20:55:19.631ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27742024-11-13T20:55:19.651ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27752024-11-13T20:55:19.652ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_94d47f77-b938-4683-89de-401156b9868f
27762024-11-13T20:55:19.678ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27772024-11-13T20:55:19.684ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27782024-11-13T20:55:19.684ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8
27792024-11-13T20:55:19.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57063
27802024-11-13T20:55:19.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57063 req_id = a5058f61-742f-4db4-b0c8-e03ee0484fc7 response_code = 200 uri = /v2p
27812024-11-13T20:55:19.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51858
27822024-11-13T20:55:19.714ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27832024-11-13T20:55:19.714ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b
27842024-11-13T20:55:19.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54558
27852024-11-13T20:55:19.736ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27862024-11-13T20:55:19.736ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27872024-11-13T20:55:19.736ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/config/omicron-zones.json file = common/src/ledger.rs:177
27882024-11-13T20:55:19.738ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/config/omicron-zones.json file = common/src/ledger.rs:177
27892024-11-13T20:55:19.748ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27902024-11-13T20:55:19.748ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2c90aa03-5691-4147-8289-5741cd7b19ba
27912024-11-13T20:55:19.759ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27922024-11-13T20:55:19.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128883 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60715 req_id = 33d16e5f-c321-4870-b2a4-8d95dccba329 response_code = 204 uri = /switch-ports
27932024-11-13T20:55:19.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60715 req_id = d37dab16-ff29-4c55-bd50-a1df1c2ed961 response_code = 200 uri = /network-bootstore-config
27942024-11-13T20:55:19.765ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 668784d0-9ec9-43d5-800e-a1a6d097030c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27952024-11-13T20:55:19.765ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_668784d0-9ec9-43d5-800e-a1a6d097030c
27962024-11-13T20:55:19.785ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27972024-11-13T20:55:19.786ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_df67e3ea-c363-421d-9d4f-d05175051931
27982024-11-13T20:55:19.802ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e43f0729-982f-4960-b10a-7966152ae48a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27992024-11-13T20:55:19.802ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e43f0729-982f-4960-b10a-7966152ae48a
28002024-11-13T20:55:19.806ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28012024-11-13T20:55:19.832ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 94d47f77-b938-4683-89de-401156b9868f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28022024-11-13T20:55:19.832ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_94d47f77-b938-4683-89de-401156b9868f
28032024-11-13T20:55:19.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36524
28042024-11-13T20:55:19.847ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 75168899-d87d-49d2-8b98-d14f7b7eb489, kind: Service { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 }, name: Name("external-dns-c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a4ccb870-86a7-4151-a1d7-4db6b1a87752, kind: Service { id: a842ec92-0a47-4cf3-961b-d511caae6dde }, name: Name("external-dns-a842ec92-0a47-4cf3-961b-d511caae6dde"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a710b2c1-2d11-4fa8-853d-ebe0de1435fb, kind: Service { id: 40a99a76-55e2-4eca-9af8-34234c9027bd }, name: Name("nexus-40a99a76-55e2-4eca-9af8-34234c9027bd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc2e8e88-8497-4746-852d-c6030d315932, kind: Service { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc }, name: Name("nexus-29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dcbb36eb-ec28-4758-b092-0592208645d7, kind: Service { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee }, name: Name("nexus-38f04d99-7fed-47a2-afac-5c2bf6458bee"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 152])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28052024-11-13T20:55:19.847ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28062024-11-13T20:55:19.847ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28072024-11-13T20:55:19.847ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28082024-11-13T20:55:19.847ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28092024-11-13T20:55:19.847ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28102024-11-13T20:55:19.847ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28112024-11-13T20:55:19.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36524 req_id = a4ba06cb-a683-4b64-9cf4-752aad1b5ec9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28122024-11-13T20:55:19.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52608
28132024-11-13T20:55:19.848ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 75168899-d87d-49d2-8b98-d14f7b7eb489, kind: Service { id: c0b478f6-c4ff-4a37-9722-a315ddbf3b23 }, name: Name("external-dns-c0b478f6-c4ff-4a37-9722-a315ddbf3b23"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a4ccb870-86a7-4151-a1d7-4db6b1a87752, kind: Service { id: a842ec92-0a47-4cf3-961b-d511caae6dde }, name: Name("external-dns-a842ec92-0a47-4cf3-961b-d511caae6dde"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: a710b2c1-2d11-4fa8-853d-ebe0de1435fb, kind: Service { id: 40a99a76-55e2-4eca-9af8-34234c9027bd }, name: Name("nexus-40a99a76-55e2-4eca-9af8-34234c9027bd"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 234, 246])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc2e8e88-8497-4746-852d-c6030d315932, kind: Service { id: 29a3fd7c-689d-4453-8c67-7ba6665d3bfc }, name: Name("nexus-29a3fd7c-689d-4453-8c67-7ba6665d3bfc"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 174])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dcbb36eb-ec28-4758-b092-0592208645d7, kind: Service { id: 38f04d99-7fed-47a2-afac-5c2bf6458bee }, name: Name("nexus-38f04d99-7fed-47a2-afac-5c2bf6458bee"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 152])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28142024-11-13T20:55:19.848ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28152024-11-13T20:55:19.848ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28162024-11-13T20:55:19.848ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28172024-11-13T20:55:19.848ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28182024-11-13T20:55:19.848ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28192024-11-13T20:55:19.848ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28202024-11-13T20:55:19.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52608 req_id = 9393dc18-5dbd-4d86-a6af-790ec661b90e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28212024-11-13T20:55:19.848ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28222024-11-13T20:55:19.848ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2
28232024-11-13T20:55:19.871ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c0ec08c2-06e7-489c-83a8-e6e8714fa7d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28242024-11-13T20:55:19.871ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c0ec08c2-06e7-489c-83a8-e6e8714fa7d8
28252024-11-13T20:55:19.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51858 req_id = 93c34caf-7a85-44db-8f32-7a86afe34a50 response_code = 204 uri = /switch-ports
28262024-11-13T20:55:19.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51858 req_id = 04beb04b-f81b-441d-b786-a245c34042c7 response_code = 200 uri = /network-bootstore-config
28272024-11-13T20:55:19.885ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28282024-11-13T20:55:19.885ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828
28292024-11-13T20:55:19.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 321879 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50660 req_id = 1ab43eb0-2174-4f8a-8a80-2b5a93922f53 response_code = 200 uri = /inventory
28302024-11-13T20:55:19.910ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2e7d6f85-ce5c-490d-89a5-0f45134b6c1b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28312024-11-13T20:55:19.910ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2e7d6f85-ce5c-490d-89a5-0f45134b6c1b
28322024-11-13T20:55:19.936ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2c90aa03-5691-4147-8289-5741cd7b19ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28332024-11-13T20:55:19.936ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2c90aa03-5691-4147-8289-5741cd7b19ba
28342024-11-13T20:55:19.962ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: df67e3ea-c363-421d-9d4f-d05175051931 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28352024-11-13T20:55:19.962ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_df67e3ea-c363-421d-9d4f-d05175051931
28362024-11-13T20:55:19.989ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ee3bdd9-a65b-4b51-8dc4-411b831155a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28372024-11-13T20:55:19.989ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0ee3bdd9-a65b-4b51-8dc4-411b831155a2
28382024-11-13T20:55:20.018ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5d5794b-cd37-472d-aa32-7a4b9d8ee828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28392024-11-13T20:55:20.018ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5d5794b-cd37-472d-aa32-7a4b9d8ee828
28402024-11-13T20:55:20.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 299406 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54558 req_id = e406ab6d-4106-4e36-87fb-18406923ee3f response_code = 200 uri = /inventory
28412024-11-13T20:55:20.933ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28422024-11-13T20:55:20.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28432024-11-13T20:55:20.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28442024-11-13T20:55:20.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28452024-11-13T20:55:27.653ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
28462024-11-13T20:55:30.935ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28472024-11-13T20:55:30.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28482024-11-13T20:55:30.937ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28492024-11-13T20:55:30.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28502024-11-13T20:55:35.333ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59319
28512024-11-13T20:55:35.333ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59319 req_id = bfef0d46-138e-4435-b9da-45699058ad61 response_code = 200 uri = /baseboard
28522024-11-13T20:55:40.936ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28532024-11-13T20:55:40.938ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28542024-11-13T20:55:40.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28552024-11-13T20:55:40.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28562024-11-13T20:55:48.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43930
28572024-11-13T20:55:48.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43930 req_id = 46b323e4-c7dc-453f-8646-f5fafeb51a6d response_code = 200 uri = /vpc-routes
28582024-11-13T20:55:48.242ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
28592024-11-13T20:55:48.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43930 req_id = cb5f3b95-b4db-41c4-8808-c62428f56a11 response_code = 204 uri = /eip-gateways
28602024-11-13T20:55:48.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43930 req_id = 5c940e69-55fd-4833-bf57-caa01a9e700a response_code = 204 uri = /vpc-routes
28612024-11-13T20:55:48.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35163
28622024-11-13T20:55:48.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35163 req_id = f8c03acc-624c-47eb-8927-b3aacd670d41 response_code = 200 uri = /v2p
28632024-11-13T20:55:48.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54505
28642024-11-13T20:55:48.351ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28652024-11-13T20:55:48.389ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28662024-11-13T20:55:48.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54505 req_id = 3bb6bce0-20ef-49fe-b46e-751ecfbff898 response_code = 204 uri = /switch-ports
28672024-11-13T20:55:48.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54505 req_id = 380dbe6e-026b-4f62-b394-14f834f71044 response_code = 200 uri = /network-bootstore-config
28682024-11-13T20:55:49.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44330
28692024-11-13T20:55:49.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44330 req_id = 44764086-c79b-41b9-bfb1-7a66ff81e07c response_code = 200 uri = /vpc-routes
28702024-11-13T20:55:49.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54551
28712024-11-13T20:55:49.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54551 req_id = eb9a2d0d-41d2-4284-bed9-e5bc07080993 response_code = 200 uri = /v2p
28722024-11-13T20:55:49.347ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
28732024-11-13T20:55:49.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44330 req_id = ad92d25d-2466-4f1e-a1fa-ffa40831f666 response_code = 204 uri = /eip-gateways
28742024-11-13T20:55:49.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48854
28752024-11-13T20:55:49.349ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28762024-11-13T20:55:49.390ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28772024-11-13T20:55:49.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104547 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48854 req_id = ffefb7d6-91a3-4c01-9a3a-cc59dd38dba8 response_code = 204 uri = /switch-ports
28782024-11-13T20:55:49.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47536
28792024-11-13T20:55:49.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44330 req_id = b3755016-d779-46f7-b303-e0be3b73f431 response_code = 204 uri = /vpc-routes
28802024-11-13T20:55:49.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47536 req_id = d4092c5c-18c3-41e1-9a85-7e8ac54dd388 response_code = 200 uri = /vpc-routes
28812024-11-13T20:55:49.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48854 req_id = d7d15201-8892-40ae-bc18-1708b9d21a23 response_code = 200 uri = /network-bootstore-config
28822024-11-13T20:55:49.495ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
28832024-11-13T20:55:49.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47536 req_id = 723eea2e-f277-4d60-a304-6894820afdec response_code = 204 uri = /eip-gateways
28842024-11-13T20:55:49.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47536 req_id = f527ac81-7f71-4448-8888-d5e5df95ad7a response_code = 204 uri = /vpc-routes
28852024-11-13T20:55:49.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52646
28862024-11-13T20:55:49.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52646 req_id = 0c410ec4-5cb4-47c5-9e60-ee482e17f687 response_code = 200 uri = /v2p
28872024-11-13T20:55:49.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55802
28882024-11-13T20:55:49.593ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28892024-11-13T20:55:49.631ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28902024-11-13T20:55:49.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55802 req_id = bc013c28-0bcf-45ff-8536-eb07b024c0eb response_code = 204 uri = /switch-ports
28912024-11-13T20:55:49.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55802 req_id = e9f29dc0-bca6-4591-90a6-bf26ed68ab73 response_code = 200 uri = /network-bootstore-config
28922024-11-13T20:55:50.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28932024-11-13T20:55:50.939ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28942024-11-13T20:55:50.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28952024-11-13T20:55:50.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28962024-11-13T20:56:00.941ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28972024-11-13T20:56:00.942ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28982024-11-13T20:56:00.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
28992024-11-13T20:56:00.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29002024-11-13T20:56:05.371ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33655
29012024-11-13T20:56:05.371ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33655 req_id = 11b2b5dc-3cbe-4277-9b83-6131914a39d6 response_code = 200 uri = /baseboard
29022024-11-13T20:56:10.943ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29032024-11-13T20:56:10.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29042024-11-13T20:56:10.944ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29052024-11-13T20:56:10.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29062024-11-13T20:56:18.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36512
29072024-11-13T20:56:18.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36512 req_id = 23f66940-6a55-4d86-9269-5e067319d780 response_code = 200 uri = /vpc-routes
29082024-11-13T20:56:18.443ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
29092024-11-13T20:56:18.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36512 req_id = 315f8f02-5063-4518-8391-47cec74b719c response_code = 204 uri = /eip-gateways
29102024-11-13T20:56:18.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36512 req_id = e8a1fe27-f030-43ab-a7a7-8a458313e136 response_code = 204 uri = /vpc-routes
29112024-11-13T20:56:18.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48753
29122024-11-13T20:56:18.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48753 req_id = cd289ff0-9f9e-4eac-ac18-01646a336943 response_code = 200 uri = /v2p
29132024-11-13T20:56:18.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39737
29142024-11-13T20:56:18.595ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29152024-11-13T20:56:18.639ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29162024-11-13T20:56:18.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106386 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39737 req_id = 2ff7b499-eff6-4141-ab3c-918c51ad49ba response_code = 204 uri = /switch-ports
29172024-11-13T20:56:18.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39737 req_id = cac33b63-63b6-4d4d-af9f-7660a38f9c46 response_code = 200 uri = /network-bootstore-config
29182024-11-13T20:56:19.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43768
29192024-11-13T20:56:19.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43768 req_id = 7a6463a2-9352-4ff0-b99f-3c04fdcccbcc response_code = 200 uri = /vpc-routes
29202024-11-13T20:56:19.266ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
29212024-11-13T20:56:19.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43768 req_id = 7e0a9f7c-004b-41bb-8d15-456aa93d0a76 response_code = 204 uri = /eip-gateways
29222024-11-13T20:56:19.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43911
29232024-11-13T20:56:19.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43911 req_id = d2871813-202c-4399-93ab-9811bdfc8e3b response_code = 200 uri = /v2p
29242024-11-13T20:56:19.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43768 req_id = 597fc3f6-a606-4556-9f50-7f9bd69f8f74 response_code = 204 uri = /vpc-routes
29252024-11-13T20:56:19.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59177
29262024-11-13T20:56:19.566ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29272024-11-13T20:56:19.610ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29282024-11-13T20:56:19.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59177 req_id = e1dbb684-3442-4f93-ad52-532fcd38ca8c response_code = 204 uri = /switch-ports
29292024-11-13T20:56:19.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45647
29302024-11-13T20:56:19.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45647 req_id = c62c0abe-e5f1-421b-89f7-de99065172bc response_code = 200 uri = /vpc-routes
29312024-11-13T20:56:19.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59177 req_id = 4a6f80cc-1bd3-430d-ad45-31f8c1e68df6 response_code = 200 uri = /network-bootstore-config
29322024-11-13T20:56:19.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58996
29332024-11-13T20:56:19.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58996 req_id = 86a85526-7d1d-4b43-999e-cf00af198e01 response_code = 200 uri = /v2p
29342024-11-13T20:56:19.712ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
29352024-11-13T20:56:19.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45647 req_id = ceae13e1-9802-4994-81db-a5dc6e573233 response_code = 204 uri = /eip-gateways
29362024-11-13T20:56:19.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45647 req_id = 1c0d000f-cf46-40d0-a1d3-9673a35a6cc0 response_code = 204 uri = /vpc-routes
29372024-11-13T20:56:19.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39969
29382024-11-13T20:56:19.815ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29392024-11-13T20:56:19.854ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29402024-11-13T20:56:19.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96224 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39969 req_id = 269cd302-7b6d-45fb-a5b4-1b2f8b22ba54 response_code = 204 uri = /switch-ports
29412024-11-13T20:56:19.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39969 req_id = 31865cc6-5015-4537-9957-f8a0e2b4f684 response_code = 200 uri = /network-bootstore-config
29422024-11-13T20:56:20.945ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29432024-11-13T20:56:20.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29442024-11-13T20:56:20.946ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29452024-11-13T20:56:20.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29462024-11-13T20:56:30.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29472024-11-13T20:56:30.947ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29482024-11-13T20:56:30.948ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29492024-11-13T20:56:30.948ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29502024-11-13T20:56:35.404ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33388
29512024-11-13T20:56:35.404ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33388 req_id = 8cc6206e-a8d4-4714-879a-9fe40c346753 response_code = 200 uri = /baseboard
29522024-11-13T20:56:40.949ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29532024-11-13T20:56:40.950ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29542024-11-13T20:56:40.950ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29552024-11-13T20:56:40.951ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29562024-11-13T20:56:48.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39402
29572024-11-13T20:56:48.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39402 req_id = eb96fca4-9a50-4028-9d54-2d6156a89de6 response_code = 200 uri = /vpc-routes
29582024-11-13T20:56:48.286ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
29592024-11-13T20:56:48.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39402 req_id = 8290c493-c217-47a6-9e81-23e027fb9f8a response_code = 204 uri = /eip-gateways
29602024-11-13T20:56:48.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39402 req_id = 2ff92928-b311-4320-89d0-031e9da7de07 response_code = 204 uri = /vpc-routes
29612024-11-13T20:56:48.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46011
29622024-11-13T20:56:48.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46011 req_id = b22be319-9874-437d-85c7-c2b773da9257 response_code = 200 uri = /v2p
29632024-11-13T20:56:48.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38058
29642024-11-13T20:56:48.501ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29652024-11-13T20:56:48.546ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29662024-11-13T20:56:48.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106780 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38058 req_id = 4bf1e752-8288-42d6-92d4-3d31d856f85a response_code = 204 uri = /switch-ports
29672024-11-13T20:56:48.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38058 req_id = b58b5613-2b4a-4c93-90a7-c7871a25bdc7 response_code = 200 uri = /network-bootstore-config
29682024-11-13T20:56:49.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53583
29692024-11-13T20:56:49.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53583 req_id = 4b238c1c-247f-47da-b49f-4681ecca0714 response_code = 200 uri = /vpc-routes
29702024-11-13T20:56:49.196ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
29712024-11-13T20:56:49.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53583 req_id = 834a53c9-eaca-495e-b830-e7343d3b67ec response_code = 204 uri = /eip-gateways
29722024-11-13T20:56:49.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35242
29732024-11-13T20:56:49.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35242 req_id = 9e174924-412d-4d39-b2d0-f643965eacdd response_code = 200 uri = /v2p
29742024-11-13T20:56:49.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53583 req_id = 43ccc88d-30ee-4aac-bfdf-f5ec83f1029c response_code = 204 uri = /vpc-routes
29752024-11-13T20:56:49.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47893
29762024-11-13T20:56:49.364ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29772024-11-13T20:56:49.408ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29782024-11-13T20:56:49.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47893 req_id = 6bcced9a-cbc3-4fe3-a7f1-898c0a2c455d response_code = 204 uri = /switch-ports
29792024-11-13T20:56:49.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45314
29802024-11-13T20:56:49.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45314 req_id = 5aab2e6a-aa61-45fe-86b1-260ce8fd766b response_code = 200 uri = /vpc-routes
29812024-11-13T20:56:49.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47893 req_id = 652f6423-b2bb-4ca2-9e59-6e458f13caf5 response_code = 200 uri = /network-bootstore-config
29822024-11-13T20:56:49.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37531
29832024-11-13T20:56:49.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37531 req_id = 08262458-6a7b-4f08-bece-5ebec3c8c555 response_code = 200 uri = /v2p
29842024-11-13T20:56:49.520ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
29852024-11-13T20:56:49.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45314 req_id = 580bb2d2-4810-4e48-a589-bbc53f75c399 response_code = 204 uri = /eip-gateways
29862024-11-13T20:56:49.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45314 req_id = 097a6d50-8d90-4bcf-917d-60b3da86bcea response_code = 204 uri = /vpc-routes
29872024-11-13T20:56:49.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45973
29882024-11-13T20:56:49.563ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29892024-11-13T20:56:49.607ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29902024-11-13T20:56:49.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106119 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45973 req_id = 94422d00-1d74-49e7-83a5-907d0fcc9a0e response_code = 204 uri = /switch-ports
29912024-11-13T20:56:49.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45973 req_id = 99feac40-abfc-4909-96f5-f242a8e9b422 response_code = 200 uri = /network-bootstore-config
29922024-11-13T20:56:50.951ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29932024-11-13T20:56:50.952ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29942024-11-13T20:56:50.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29952024-11-13T20:56:50.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29962024-11-13T20:57:00.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29972024-11-13T20:57:00.953ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29982024-11-13T20:57:00.954ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
29992024-11-13T20:57:00.954ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
30002024-11-13T20:57:05.437ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45692
30012024-11-13T20:57:05.437ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45692 req_id = a67110c3-df06-4e47-bde8-0b82c7b7c30a response_code = 200 uri = /baseboard
30022024-11-13T20:57:08.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62396
30032024-11-13T20:57:08.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62396 req_id = c3403b33-8648-4144-94fe-84093dc6add7 response_code = 200 uri = /v2p
30042024-11-13T20:57:08.978ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(9298815) }
30052024-11-13T20:57:08.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62396 req_id = 44c7a23f-d4e5-4295-b698-afecc8b30ba3 response_code = 204 uri = /v2p
30062024-11-13T20:57:09.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44765
30072024-11-13T20:57:09.263ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e5095cbc-4e23-416a-908b-1766e2c2b25c, kind: Instance { id: 632ae910-aec9-47df-88cf-953aa24a68ab }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9298815), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e5095cbc-4e23-416a-908b-1766e2c2b25c, kind: Instance { id: 632ae910-aec9-47df-88cf-953aa24a68ab }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9298815), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e5095cbc-4e23-416a-908b-1766e2c2b25c, kind: Instance { id: 632ae910-aec9-47df-88cf-953aa24a68ab }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9298815), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9298815))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e5095cbc-4e23-416a-908b-1766e2c2b25c, kind: Instance { id: 632ae910-aec9-47df-88cf-953aa24a68ab }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9298815), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-51ce32101de", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 5ff4538d-773b-4454-8cae-ca9f06f94394, read_only_parent: Some(Volume { block_size: 512, id: 0d3b17ff-123c-4740-b28f-045e487a9601, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 15ddff96-ebb3-4a32-8523-27747f0d2025, key: Some("oIIjIJCTZcfoxjo+Y/Dq9XPEG3Flz48DOUAGID8AlSw="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::17]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5ff4538d-773b-4454-8cae-ca9f06f94394, key: Some("RWKj6e+M182vl/HYp0stlcpxX4+/MBnYZXovQxI8V+o="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-51ce32101de" }] }), cloud_init_bytes: Some(..) } instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab metadata = InstanceMetadata { silo_id: 307b9412-9fcb-4452-b635-41dcccef9721, project_id: 5b4b7c9a-9f2b-441c-9ffe-bd5b07d9df43 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-13T20:57:09.259752022Z }
30082024-11-13T20:57:09.263ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab migration_id = None propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30092024-11-13T20:57:09.263ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab migration_id = None propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e5095cbc-4e23-416a-908b-1766e2c2b25c, kind: Instance { id: 632ae910-aec9-47df-88cf-953aa24a68ab }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9298815), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e5095cbc-4e23-416a-908b-1766e2c2b25c, kind: Instance { id: 632ae910-aec9-47df-88cf-953aa24a68ab }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9298815), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e5095cbc-4e23-416a-908b-1766e2c2b25c, kind: Instance { id: 632ae910-aec9-47df-88cf-953aa24a68ab }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9298815), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9298815))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e5095cbc-4e23-416a-908b-1766e2c2b25c, kind: Instance { id: 632ae910-aec9-47df-88cf-953aa24a68ab }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9298815), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-51ce32101de", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 5ff4538d-773b-4454-8cae-ca9f06f94394, read_only_parent: Some(Volume { block_size: 512, id: 0d3b17ff-123c-4740-b28f-045e487a9601, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 15ddff96-ebb3-4a32-8523-27747f0d2025, key: Some("oIIjIJCTZcfoxjo+Y/Dq9XPEG3Flz48DOUAGID8AlSw="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::17]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5ff4538d-773b-4454-8cae-ca9f06f94394, key: Some("RWKj6e+M182vl/HYp0stlcpxX4+/MBnYZXovQxI8V+o="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::1a]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-51ce32101de" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-13T20:57:09.259752022Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
30102024-11-13T20:57:09.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3637 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44765 req_id = 667d72e6-953f-40b1-a9ba-6c4e33a550a2 response_code = 200 uri = /vmms/68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30112024-11-13T20:57:09.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58375
30122024-11-13T20:57:09.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58375 req_id = cebdfbde-a584-4818-b47a-e87cd28dec93 response_code = 200 uri = /vmms/68c1c88f-3d5d-4e2d-b6ec-525a0e859852/state
30132024-11-13T20:57:09.359ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 9298815 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
30142024-11-13T20:57:09.359ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30152024-11-13T20:57:09.404ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852 file = illumos-utils/src/zone.rs:325 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30162024-11-13T20:57:09.428ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852 file = illumos-utils/src/zone.rs:363 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30172024-11-13T20:57:09.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34911
30182024-11-13T20:57:09.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34911 req_id = 621c51c3-6bed-468b-820e-8cd8721ff870 response_code = 200 uri = /vpc-routes
30192024-11-13T20:57:09.456ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {e5095cbc-4e23-416a-908b-1766e2c2b25c: {10.151.2.175: {9eab18d7-9118-4683-82cc-4d583ab9274d}, 10.151.2.176: {9eab18d7-9118-4683-82cc-4d583ab9274d}}} }
30202024-11-13T20:57:10.640ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30212024-11-13T20:57:10.640ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 zone = oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30222024-11-13T20:57:10.892ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852") failed: Property not found. retry in 52.694603ms file = illumos-utils/src/svc.rs:36 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 zone = oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30232024-11-13T20:57:10.957ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
30242024-11-13T20:57:10.957ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
30252024-11-13T20:57:10.957ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
30262024-11-13T20:57:10.958ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
30272024-11-13T20:57:10.960ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852") failed: Property not found. retry in 68.789709ms file = illumos-utils/src/svc.rs:36 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 zone = oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30282024-11-13T20:57:11.050ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852") failed: Property not found. retry in 115.125963ms file = illumos-utils/src/svc.rs:36 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 zone = oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30292024-11-13T20:57:11.182ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852") failed: Property not found. retry in 589.835924ms file = illumos-utils/src/svc.rs:36 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 zone = oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30302024-11-13T20:57:11.794ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852") failed: Property not found. retry in 1.046900229s file = illumos-utils/src/svc.rs:36 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 zone = oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30312024-11-13T20:57:12.853ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852") failed: Property not found. retry in 1.461363195s file = illumos-utils/src/svc.rs:36 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 zone = oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30322024-11-13T20:57:14.327ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852") failed: Property not found. retry in 1.149823309s file = illumos-utils/src/svc.rs:36 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 zone = oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30332024-11-13T20:57:15.491ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852") failed: Property not found. retry in 1.02761178s file = illumos-utils/src/svc.rs:36 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 zone = oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30342024-11-13T20:57:16.552ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852 file = sled-agent/src/instance.rs:1787 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30352024-11-13T20:57:16.562ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30362024-11-13T20:57:16.599ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30372024-11-13T20:57:16.736ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30382024-11-13T20:57:16.737ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
30392024-11-13T20:57:16.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7281057 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34911 req_id = aea0274b-2d67-4396-9270-3932afc09140 response_code = 204 uri = /eip-gateways
30402024-11-13T20:57:16.738ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-13T20:57:16.737985833Z } file = sled-agent/src/instance.rs:780 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30412024-11-13T20:57:16.738ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-13T20:57:16.737985833Z } propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30422024-11-13T20:57:16.738ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-13T20:57:16.737985833Z }, migration_in: None, migration_out: None }
30432024-11-13T20:57:16.785ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-13T20:57:16.785351123Z } file = sled-agent/src/instance.rs:780 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30442024-11-13T20:57:16.785ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-13T20:57:16.785351123Z } propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30452024-11-13T20:57:16.785ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-13T20:57:16.785351123Z }, migration_in: None, migration_out: None }
30462024-11-13T20:57:16.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34911 req_id = 40f8558b-9263-422d-a351-ebc18c96b59b response_code = 204 uri = /vpc-routes
30472024-11-13T20:57:18.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48858
30482024-11-13T20:57:18.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48858 req_id = d40d921c-40f0-4562-bc80-8af1ba81c3e8 response_code = 200 uri = /vmms/68c1c88f-3d5d-4e2d-b6ec-525a0e859852/state
30492024-11-13T20:57:18.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52907
30502024-11-13T20:57:18.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52907 req_id = f48b4a10-61c1-41d9-89fe-2deae9e7daad response_code = 200 uri = /vpc-routes
30512024-11-13T20:57:18.461ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {e5095cbc-4e23-416a-908b-1766e2c2b25c: {10.151.2.175: {9eab18d7-9118-4683-82cc-4d583ab9274d}, 10.151.2.176: {9eab18d7-9118-4683-82cc-4d583ab9274d}}} }
30522024-11-13T20:57:18.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52907 req_id = 4a8a7c92-ceca-48ef-b10c-574575eef827 response_code = 204 uri = /eip-gateways
30532024-11-13T20:57:18.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52907 req_id = 08ee497f-4f3c-4218-917f-85af7d215b22 response_code = 204 uri = /vpc-routes
30542024-11-13T20:57:18.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57435
30552024-11-13T20:57:18.518ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30562024-11-13T20:57:18.564ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30572024-11-13T20:57:18.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108184 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57435 req_id = 63b19a87-b45c-4c3c-ad76-5f82de86cf66 response_code = 204 uri = /switch-ports
30582024-11-13T20:57:18.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57084
30592024-11-13T20:57:18.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57084 req_id = d4c014ef-ae5e-4115-85a3-09c0d0fa6a3d response_code = 200 uri = /v2p
30602024-11-13T20:57:18.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57435 req_id = a6eed4a3-f468-4658-9c72-469f55575510 response_code = 200 uri = /network-bootstore-config
30612024-11-13T20:57:19.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37715
30622024-11-13T20:57:19.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37715 req_id = a05e49de-376f-4550-871d-9f414e3b86d1 response_code = 200 uri = /vpc-routes
30632024-11-13T20:57:19.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61635
30642024-11-13T20:57:19.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61635 req_id = cd4fe331-13ad-4d8d-bf40-1d4311df3b49 response_code = 200 uri = /v2p
30652024-11-13T20:57:19.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42381
30662024-11-13T20:57:19.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42381 req_id = 04e42166-46f8-4fcb-baef-3413fdb91bd6 response_code = 200 uri = /vmms/68c1c88f-3d5d-4e2d-b6ec-525a0e859852/state
30672024-11-13T20:57:19.468ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {e5095cbc-4e23-416a-908b-1766e2c2b25c: {10.151.2.176: {9eab18d7-9118-4683-82cc-4d583ab9274d}, 10.151.2.175: {9eab18d7-9118-4683-82cc-4d583ab9274d}}} }
30682024-11-13T20:57:19.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37715 req_id = 5e47228c-ff22-447d-938a-bcd899fbf4d2 response_code = 204 uri = /eip-gateways
30692024-11-13T20:57:19.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37715 req_id = 67562331-e14e-456b-b604-210faa51d6c0 response_code = 204 uri = /vpc-routes
30702024-11-13T20:57:19.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55729
30712024-11-13T20:57:19.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55729 req_id = db7d8b3a-bb4c-4f46-b550-65a255154aae response_code = 200 uri = /vmms/68c1c88f-3d5d-4e2d-b6ec-525a0e859852/state
30722024-11-13T20:57:19.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45900
30732024-11-13T20:57:19.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45900 req_id = e8e683b0-53df-46a7-8d8b-2ab3d2891d07 response_code = 200 uri = /vpc-routes
30742024-11-13T20:57:19.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37630
30752024-11-13T20:57:19.589ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30762024-11-13T20:57:19.641ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30772024-11-13T20:57:19.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135000 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37630 req_id = 4969f3ee-20a2-4a8b-a526-28ea174ef9ee response_code = 204 uri = /switch-ports
30782024-11-13T20:57:19.724ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {e5095cbc-4e23-416a-908b-1766e2c2b25c: {10.151.2.176: {9eab18d7-9118-4683-82cc-4d583ab9274d}, 10.151.2.175: {9eab18d7-9118-4683-82cc-4d583ab9274d}}} }
30792024-11-13T20:57:19.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45900 req_id = 601b1308-5331-4c4f-b96d-72f3a41cae37 response_code = 204 uri = /eip-gateways
30802024-11-13T20:57:19.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37630 req_id = 675ea87f-f5a8-490d-af46-8bd9b088afb4 response_code = 200 uri = /network-bootstore-config
30812024-11-13T20:57:19.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42244
30822024-11-13T20:57:19.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42244 req_id = 33cacac7-83ef-44ae-bca9-17eebacd8632 response_code = 200 uri = /v2p
30832024-11-13T20:57:19.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45900 req_id = 985aabb7-ef59-4081-aa10-acde34d0b24f response_code = 204 uri = /vpc-routes
30842024-11-13T20:57:19.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46247
30852024-11-13T20:57:19.822ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30862024-11-13T20:57:19.869ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30872024-11-13T20:57:19.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112819 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46247 req_id = 974b92d9-b8c4-450e-8b91-578405e11d74 response_code = 204 uri = /switch-ports
30882024-11-13T20:57:19.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46247 req_id = 12141c61-b4ed-4764-a9ee-4ea06dafa70b response_code = 200 uri = /network-bootstore-config
30892024-11-13T20:57:20.957ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
30902024-11-13T20:57:20.958ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
30912024-11-13T20:57:20.959ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
30922024-11-13T20:57:20.959ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
30932024-11-13T20:57:26.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39762
30942024-11-13T20:57:26.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 723 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39762 req_id = b49b7bf2-df80-468f-8d52-213a7f1de585 response_code = 200 uri = /vmms/68c1c88f-3d5d-4e2d-b6ec-525a0e859852/state
30952024-11-13T20:57:26.998ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-13T20:57:26.998932076Z } file = sled-agent/src/instance.rs:780 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30962024-11-13T20:57:26.999ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-13T20:57:26.998932076Z } propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30972024-11-13T20:57:26.999ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-13T20:57:26.998932076Z }, migration_in: None, migration_out: None }
30982024-11-13T20:57:27.036ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-13T20:57:27.036498094Z } file = sled-agent/src/instance.rs:780 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
30992024-11-13T20:57:27.036ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-13T20:57:27.036498094Z } propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
31002024-11-13T20:57:27.036ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
31012024-11-13T20:57:27.036ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31022024-11-13T20:57:27.036ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 4044845222666706605 n_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
31032024-11-13T20:57:27.036ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 16429878058463185473 n_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
31042024-11-13T20:57:27.036ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31052024-11-13T20:57:27.036ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/8bbfd2a1-1a2f-4810-a443-21874c43f88a/debug/bundle/zone", "/pool/int/b7cb2d93-67d8-40f4-ba66-b9d64de62594/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/668784d0-9ec9-43d5-800e-a1a6d097030c/crypt/debug", "/pool/ext/e43f0729-982f-4960-b10a-7966152ae48a/crypt/debug", "/pool/ext/94d47f77-b938-4683-89de-401156b9868f/crypt/debug", "/pool/ext/c0ec08c2-06e7-489c-83a8-e6e8714fa7d8/crypt/debug", "/pool/ext/2e7d6f85-ce5c-490d-89a5-0f45134b6c1b/crypt/debug", "/pool/ext/2c90aa03-5691-4147-8289-5741cd7b19ba/crypt/debug", "/pool/ext/df67e3ea-c363-421d-9d4f-d05175051931/crypt/debug", "/pool/ext/0ee3bdd9-a65b-4b51-8dc4-411b831155a2/crypt/debug", "/pool/ext/c5d5794b-cd37-472d-aa32-7a4b9d8ee828/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852
31062024-11-13T20:57:27.745ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852", bundle_id: 9253b1d2-2a73-452a-a574-927ea8bf17ec }, time_created: 2024-11-13T20:57:27.037376210Z, version: 0, cause: TerminatedInstance }
31072024-11-13T20:57:27.745ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_68c1c88f-3d5d-4e2d-b6ec-525a0e859852 file = sled-agent/src/instance.rs:1032 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
31082024-11-13T20:57:29.505ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
31092024-11-13T20:57:29.523ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(9298815), kind: System }
31102024-11-13T20:57:29.523ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(9298815), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
31112024-11-13T20:57:29.529ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-13T20:57:29.529501869Z }, migration_in: None, migration_out: None }
31122024-11-13T20:57:29.603ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-13T20:57:29.529501869Z }, migration_in: None, migration_out: None }
31132024-11-13T20:57:29.606ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 632ae910-aec9-47df-88cf-953aa24a68ab propolis_id = 68c1c88f-3d5d-4e2d-b6ec-525a0e859852
31142024-11-13T20:57:30.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40577
31152024-11-13T20:57:30.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40577 req_id = 52987e48-3487-4aca-9f4c-437f94f2d7c1 response_code = 200 uri = /vpc-routes
31162024-11-13T20:57:30.864ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {e5095cbc-4e23-416a-908b-1766e2c2b25c: {10.151.2.175: {9eab18d7-9118-4683-82cc-4d583ab9274d}, 10.151.2.176: {9eab18d7-9118-4683-82cc-4d583ab9274d}}} }
31172024-11-13T20:57:30.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40577 req_id = 1a58dd31-e4ec-48a3-8e98-00301fc2ddcc response_code = 204 uri = /eip-gateways
31182024-11-13T20:57:30.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40577 req_id = c3543624-751a-44b3-9c82-74bee1359917 response_code = 204 uri = /vpc-routes
31192024-11-13T20:57:30.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51027
31202024-11-13T20:57:30.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51027 req_id = 9a08569a-74e0-4ea2-9fa2-02089ffc8e0a response_code = 200 uri = /v2p
31212024-11-13T20:57:30.958ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
31222024-11-13T20:57:30.960ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
31232024-11-13T20:57:30.960ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
31242024-11-13T20:57:30.961ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = b6e177bd-5357-4f01-b047-206109321c43
31252024-11-13T20:57:31.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37611
31262024-11-13T20:57:31.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37611 req_id = e1ba573c-15b7-478c-b795-4e2000319869 response_code = 200 uri = /v2p
31272024-11-13T20:57:32.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40997
31282024-11-13T20:57:32.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40997 req_id = ea68e902-cc9c-4119-8aba-301ccb085169 response_code = 200 uri = /vpc-routes
31292024-11-13T20:57:32.366ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
31302024-11-13T20:57:32.366ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = b6e177bd-5357-4f01-b047-206109321c43
31312024-11-13T20:57:32.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40997 req_id = 17cbe0d9-b964-442b-87fa-af91c6e3ab3c response_code = 204 uri = /eip-gateways
31322024-11-13T20:57:32.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40997 req_id = 9cc2d715-fa03-40b3-9211-9ca8c9dc629d response_code = 204 uri = /vpc-routes
31332024-11-13T20:57:34.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33665
31342024-11-13T20:57:34.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33665 req_id = d3f5d804-6b02-483a-8e18-38094281b9d1 response_code = 200 uri = /vpc-routes
31352024-11-13T20:57:34.210ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = b6e177bd-5357-4f01-b047-206109321c43 values = ExternalIpGatewayMap { mappings: {} }
31362024-11-13T20:57:34.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33665 req_id = 955fbcbf-99ac-4b7d-8212-0de599af0deb response_code = 204 uri = /eip-gateways
31372024-11-13T20:57:34.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33665 req_id = 7b424bb0-d404-4211-9e88-37e6efda25ec response_code = 204 uri = /vpc-routes
31382024-11-13T20:57:35.473ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44052
31392024-11-13T20:57:35.473ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44052 req_id = efc38bbc-d106-48eb-ab50-2e066be610d8 response_code = 200 uri = /baseboard