Max level shown:
1 [ Nov 15 21:38:03 Enabled. ]
2 [ Nov 15 21:38:03 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 15 21:38:03 Method "start" exited with status 0. ]
4 [ Nov 15 21:38:03 Rereading configuration. ]
5 [ Nov 15 21:38:03 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-15T21:38:03.369ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-15T21:38:03.369ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-15T21:38:03.422ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-15T21:38:03.422ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-15T21:38:03.535ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-15T21:38:03.544ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-15T21:38:03.553ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-15T21:38:04.154ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-11-15T21:38:04.290ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-15T21:38:04.291ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-15T21:38:04.291ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-15T21:38:04.291ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-15T21:38:04.291ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-15T21:38:04.291ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-15T21:38:04.294ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-15T21:38:04.294ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-15T21:38:04.294ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-15T21:38:04.294ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-15T21:38:04.294ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-15T21:38:04.294ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-15T21:38:04.294ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-15T21:38:04.294ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-15T21:38:04.294ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-15T21:38:04.305ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-15T21:38:04.305ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool)
322024-11-15T21:38:04.403ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal }
332024-11-15T21:38:04.883ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-15T21:38:04.883ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-15T21:38:04.883ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-15T21:38:04.883ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-15T21:38:04.883ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-15T21:38:04.883ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-15T21:38:04.883ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-15T21:38:04.891ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-15T21:38:04.891ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool)
422024-11-15T21:38:04.979ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal }
432024-11-15T21:38:05.457ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-15T21:38:05.457ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-11-15T21:38:05.457ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-11-15T21:38:05.457ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-15T21:38:05.457ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-15T21:38:05.457ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-11-15T21:38:05.457ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-11-15T21:38:05.457ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-15T21:38:05.457ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-15T21:38:05.457ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-15T21:38:05.457ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-11-15T21:38:05.457ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-11-15T21:38:05.457ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-15T21:38:05.457ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-11-15T21:38:05.457ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-11-15T21:38:05.457ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-11-15T21:38:05.457ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-15T21:38:05.457ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-15T21:38:05.457ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-15T21:38:05.457ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-15T21:38:05.457ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-15T21:38:05.457ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-15T21:38:05.457ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-15T21:38:05.457ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-15T21:38:05.457ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-15T21:38:05.457ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-11-15T21:38:05.457ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
842024-11-15T21:38:05.457ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-15T21:38:05.457ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-15T21:38:05.457ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892024-11-15T21:38:05.457ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
902024-11-15T21:38:05.457ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-11-15T21:38:05.457ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-15T21:38:05.457ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952024-11-15T21:38:05.457ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
962024-11-15T21:38:05.457ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-11-15T21:38:05.457ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-15T21:38:05.457ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1002024-11-15T21:38:05.457ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1012024-11-15T21:38:05.457ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022024-11-15T21:38:05.457ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-15T21:38:05.457ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-15T21:38:05.457ZINFOSledAgent (bootstore): No ledger in /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-11-15T21:38:05.457ZINFOSledAgent (bootstore): No ledger in /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-11-15T21:38:05.457ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-11-15T21:38:05.457ZINFOSledAgent (bootstore): No ledger in /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-11-15T21:38:05.457ZINFOSledAgent (bootstore): No ledger in /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-11-15T21:38:05.457ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-11-15T21:38:05.457ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-15T21:38:05.457ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-15T21:38:05.468ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-15T21:38:05.468ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1368, tv_nsec: 22680870 } time_to_next_cleanup = 599.999922989s
1142024-11-15T21:38:05.468ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-11-15T21:38:05.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-15T21:38:05.468ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-15T21:38:05.471ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-15T21:38:05.472ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-11-15T21:38:05.473ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-11-15T21:38:05.473ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-15T21:38:05.473ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-15T21:38:05.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-15T21:38:05.474ZINFOSledAgent (RSS): No ledger in /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-15T21:38:05.474ZINFOSledAgent (RSS): No ledger in /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-15T21:38:05.474ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-15T21:38:05.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-15T21:38:05.474ZINFOSledAgent (RSS): No ledger in /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-15T21:38:05.474ZINFOSledAgent (RSS): No ledger in /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-15T21:38:05.474ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-15T21:38:05.474ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-15T21:38:05.474ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-15T21:38:05.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-15T21:38:05.474ZINFOSledAgent (RSS): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-15T21:38:05.474ZINFOSledAgent (RSS): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-15T21:38:05.475ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, sleds: { [fdb0:18c0:4d0d:a02a::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 78d47478-5af8-488d-89c5-11be23443b63 (sled), rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-15T21:38:05.475ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1372024-11-15T21:38:05.475ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-11-15T21:38:05.475ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-11-15T21:38:05.475ZINFOSledAgent (bootstore): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-11-15T21:38:05.475ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-11-15T21:38:05.475ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 78d47478-5af8-488d-89c5-11be23443b63 (sled), rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-11-15T21:38:05.475ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1432024-11-15T21:38:05.475ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1442024-11-15T21:38:05.480ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-15T21:38:05.486ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-15T21:38:05.486ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-15T21:38:05.490ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-15T21:38:05.490ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-15T21:38:05.490ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:60493
1502024-11-15T21:38:05.490ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 78d47478-5af8-488d-89c5-11be23443b63 (sled), rack_id: ddfb397a-b658-4566-9e9b-db5e51d8a967, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-15T21:38:05.490ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-15T21:38:05.490ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-15T21:38:05.490ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-15T21:38:05.490ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-11-15T21:38:05.490ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-11-15T21:38:05.490ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1572024-11-15T21:38:05.490ZINFOSledAgent (StorageManager): No ledger in /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-11-15T21:38:05.490ZINFOSledAgent (StorageManager): No ledger in /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-15T21:38:05.490ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-11-15T21:38:05.490ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-11-15T21:38:05.490ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-11-15T21:38:05.490ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-15T21:38:05.490ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-15T21:38:05.506ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-15T21:38:05.526ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-15T21:38:05.543ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-15T21:38:05.573ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
1682024-11-15T21:38:05.573ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-15T21:38:05.573ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
1702024-11-15T21:38:05.573ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-15T21:38:05.575ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 114.770491ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d5efe8d4-8b79-4404-9e64-b83b2d382f8d", "content-length": "124", "date": "Fri, 15 Nov 2024 21:38:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d5efe8d4-8b79-4404-9e64-b83b2d382f8d" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-15T21:38:05.585ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_d51009ae-3f60-480d-999c-9e7ec880cfcb/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-15T21:38:05.608ZINFOSledAgent: successfully created encrypted zvol: name="oxi_d51009ae-3f60-480d-999c-9e7ec880cfcb/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-15T21:38:05.608ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_d51009ae-3f60-480d-999c-9e7ec880cfcb/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-15T21:38:05.613ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
1762024-11-15T21:38:05.613ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-15T21:38:05.613ZINFOSledAgent (BackingFs): Ensuring dataset oxi_d51009ae-3f60-480d-999c-9e7ec880cfcb/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-15T21:38:05.692ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-15T21:38:05.692ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 147.637184ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b9f3c51b-8daa-4d3b-827f-6f94060c34a7", "content-length": "124", "date": "Fri, 15 Nov 2024 21:38:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b9f3c51b-8daa-4d3b-827f-6f94060c34a7" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-15T21:38:05.698ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-15T21:38:05.840ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-15T21:38:05.841ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 101.63386ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dcc7c40d-0c9c-435c-89a1-459cbea1970f", "content-length": "124", "date": "Fri, 15 Nov 2024 21:38:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dcc7c40d-0c9c-435c-89a1-459cbea1970f" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-15T21:38:05.917ZINFOSledAgent (BackingFs): Mounting oxi_d51009ae-3f60-480d-999c-9e7ec880cfcb/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-11-15T21:38:05.930ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-11-15T21:38:05.930ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-11-15T21:38:05.930ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-11-15T21:38:05.930ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-11-15T21:38:05.944ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-11-15T21:38:05.945ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 168.523017ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "da3162d9-4246-4801-9cdd-b717ca857666", "content-length": "124", "date": "Fri, 15 Nov 2024 21:38:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "da3162d9-4246-4801-9cdd-b717ca857666" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-11-15T21:38:06.114ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-15T21:38:06.114ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 152.602608ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "898fcb64-4c91-4f6c-901e-643e23d8aede", "content-length": "124", "date": "Fri, 15 Nov 2024 21:38:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "898fcb64-4c91-4f6c-901e-643e23d8aede" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-15T21:38:06.268ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-15T21:38:06.269ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 332.1498ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e4d9c59a-c320-417e-a887-ac4e914c4d11", "content-length": "124", "date": "Fri, 15 Nov 2024 21:38:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e4d9c59a-c320-417e-a887-ac4e914c4d11" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-15T21:38:06.602ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-15T21:38:06.603ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 400.410133ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9e358a5d-ee31-459f-affa-1919f5f2be7c", "content-length": "124", "date": "Fri, 15 Nov 2024 21:38:06 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9e358a5d-ee31-459f-affa-1919f5f2be7c" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-15T21:38:06.681ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
1972024-11-15T21:38:06.686ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:59011 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
1982024-11-15T21:38:06.686ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
1992024-11-15T21:38:06.686ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:59011 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 78d47478-5af8-488d-89c5-11be23443b63 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2002024-11-15T21:38:06.687ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 321.070683ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2012024-11-15T21:38:06.688ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2022024-11-15T21:38:06.688ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2032024-11-15T21:38:06.689ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2042024-11-15T21:38:06.689ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-11-15T21:38:07.004ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2062024-11-15T21:38:07.010ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 741.699277ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2072024-11-15T21:38:07.754ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 581.628629ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2082024-11-15T21:38:08.337ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.087433394s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2092024-11-15T21:38:09.273ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2102024-11-15T21:38:09.273ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2112024-11-15T21:38:09.273ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2122024-11-15T21:38:09.273ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2132024-11-15T21:38:09.273ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2142024-11-15T21:38:09.273ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2152024-11-15T21:38:09.275ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2162024-11-15T21:38:09.277ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2172024-11-15T21:38:09.277ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='97598fa2-4ef4-4fda-9111-75c99f8284f6'/> <propval type="astring" name="rack_id" value='ddfb397a-b658-4566-9e9b-db5e51d8a967'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fed4:5e4'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='ddfb397a-b658-4566-9e9b-db5e51d8a967'/> <propval type="astring" name="sled_id" value='78d47478-5af8-488d-89c5-11be23443b63'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='78d47478-5af8-488d-89c5-11be23443b63'/> <propval type="astring" name="rack_uuid" value='ddfb397a-b658-4566-9e9b-db5e51d8a967'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='78d47478-5af8-488d-89c5-11be23443b63'/> <propval type="astring" name="rack_uuid" value='ddfb397a-b658-4566-9e9b-db5e51d8a967'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-15T21:38:09.277ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-15T21:38:09.426ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.699370759s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2202024-11-15T21:38:09.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 56.535238ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-15T21:38:09.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 53.3019ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-15T21:38:10.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 244.406565ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-15T21:38:10.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 530.139344ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-15T21:38:10.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 583.693406ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-15T21:38:11.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 743.85352ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-15T21:38:12.128ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.446843174s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2272024-11-15T21:38:12.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 753.315608ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-15T21:38:13.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.284561329s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-15T21:38:15.283ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/nexus.rs:527 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2302024-11-15T21:38:15.313ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2312024-11-15T21:38:15.314ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2322024-11-15T21:38:15.315ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2332024-11-15T21:38:15.315ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2342024-11-15T21:38:15.315ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2352024-11-15T21:38:15.315ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-15T21:38:15.315ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-15T21:38:15.315ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2382024-11-15T21:38:15.315ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2392024-11-15T21:38:15.315ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2402024-11-15T21:38:15.315ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:60493
2412024-11-15T21:38:15.520ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2422024-11-15T21:38:15.520ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2432024-11-15T21:38:15.520ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2442024-11-15T21:38:15.520ZINFOSledAgent (RSS): No ledger in /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-15T21:38:15.520ZINFOSledAgent (RSS): No ledger in /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-15T21:38:15.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-15T21:38:15.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-15T21:38:15.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-11-15T21:38:15.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-15T21:38:15.525ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2512024-11-15T21:38:15.525ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2522024-11-15T21:38:15.525ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2532024-11-15T21:38:15.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43170
2542024-11-15T21:38:15.805ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2552024-11-15T21:38:15.805ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-15T21:38:15.805ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-11-15T21:38:15.805ZINFOSledAgent (ServiceManager): No ledger in /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-15T21:38:15.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43170 req_id = 7f4ffd75-45d6-48db-9b17-2536ccdcc9a1 response_code = 200 uri = /inventory
2592024-11-15T21:38:15.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42321
2602024-11-15T21:38:15.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42321 req_id = 206dc32d-70df-4c82-a156-ee2580518a57 response_code = 200 uri = /sled-role
2612024-11-15T21:38:15.838ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2622024-11-15T21:38:15.838ZINFOSledAgent (RSS): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-11-15T21:38:15.838ZINFOSledAgent (RSS): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-15T21:38:15.838ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2652024-11-15T21:38:15.868ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: d2973f47-2039-42b4-94ac-c5b972b6d8d0, pool_id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 8af28445-e148-45e2-b778-3595112715c8, pool_id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: cfc4b208-c8c7-4a7d-8683-f1c15485e5cc, pool_id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 191a1062-b386-4b32-9125-bde1f2ffff63, pool_id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b3d69244-e9ab-4904-b1ea-bf94a30a071e, pool_id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: f246c822-9cdd-4979-af95-ba02db82f87b, pool_id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 143db93e-dde1-4201-93c1-ec3232e0fc99, pool_id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: f24a162e-8149-4c6b-acf3-feb07a3423c3, pool_id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: c5343947-2d73-4acd-8d69-65aaaa1e6191, pool_id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2662024-11-15T21:38:15.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33604
2672024-11-15T21:38:15.868ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:884 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2682024-11-15T21:38:15.868ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: d2973f47-2039-42b4-94ac-c5b972b6d8d0, pool_id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 8af28445-e148-45e2-b778-3595112715c8, pool_id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: cfc4b208-c8c7-4a7d-8683-f1c15485e5cc, pool_id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 191a1062-b386-4b32-9125-bde1f2ffff63, pool_id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b3d69244-e9ab-4904-b1ea-bf94a30a071e, pool_id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: f246c822-9cdd-4979-af95-ba02db82f87b, pool_id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 143db93e-dde1-4201-93c1-ec3232e0fc99, pool_id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: f24a162e-8149-4c6b-acf3-feb07a3423c3, pool_id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: c5343947-2d73-4acd-8d69-65aaaa1e6191, pool_id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2692024-11-15T21:38:15.868ZINFOSledAgent (StorageManager): No ledger in /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-11-15T21:38:15.868ZINFOSledAgent (StorageManager): No ledger in /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-15T21:38:15.868ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2722024-11-15T21:38:15.868ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2732024-11-15T21:38:15.868ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2742024-11-15T21:38:15.868ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2752024-11-15T21:38:15.868ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2762024-11-15T21:38:16.076ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2772024-11-15T21:38:16.076ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool)
2782024-11-15T21:38:16.316ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2792024-11-15T21:38:16.767ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2802024-11-15T21:38:16.767ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2812024-11-15T21:38:17.013ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
2822024-11-15T21:38:17.043ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }
2832024-11-15T21:38:17.052ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2842024-11-15T21:38:17.052ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2852024-11-15T21:38:17.052ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2862024-11-15T21:38:17.052ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2872024-11-15T21:38:17.052ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-11-15T21:38:17.053ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-11-15T21:38:17.053ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2902024-11-15T21:38:17.088ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-11-15T21:38:17.097ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone file = sled-storage/src/dataset.rs:303
2922024-11-15T21:38:17.273ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50 file = sled-storage/src/dataset.rs:389
2932024-11-15T21:38:17.281ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2942024-11-15T21:38:17.281ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2952024-11-15T21:38:17.281ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2962024-11-15T21:38:17.281ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2972024-11-15T21:38:17.281ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2982024-11-15T21:38:17.291ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2992024-11-15T21:38:17.291ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool)
3002024-11-15T21:38:17.390ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }
3012024-11-15T21:38:17.398ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3022024-11-15T21:38:17.398ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3032024-11-15T21:38:17.398ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3042024-11-15T21:38:17.398ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3052024-11-15T21:38:17.398ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3062024-11-15T21:38:17.398ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-15T21:38:17.398ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3082024-11-15T21:38:17.402ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
3092024-11-15T21:38:17.434ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3102024-11-15T21:38:17.443ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/zone file = sled-storage/src/dataset.rs:303
3112024-11-15T21:38:17.616ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9 file = sled-storage/src/dataset.rs:389
3122024-11-15T21:38:17.624ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3132024-11-15T21:38:17.624ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3142024-11-15T21:38:17.624ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3152024-11-15T21:38:17.624ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3162024-11-15T21:38:17.624ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3172024-11-15T21:38:17.634ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3182024-11-15T21:38:17.634ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool)
3192024-11-15T21:38:17.725ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }
3202024-11-15T21:38:17.733ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3212024-11-15T21:38:17.733ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3222024-11-15T21:38:17.733ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3232024-11-15T21:38:17.733ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3242024-11-15T21:38:17.733ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-15T21:38:17.734ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-11-15T21:38:17.734ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3272024-11-15T21:38:17.769ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3282024-11-15T21:38:17.777ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/zone file = sled-storage/src/dataset.rs:303
3292024-11-15T21:38:17.946ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876 file = sled-storage/src/dataset.rs:389
3302024-11-15T21:38:17.954ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3312024-11-15T21:38:17.954ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3322024-11-15T21:38:17.954ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3332024-11-15T21:38:17.954ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3342024-11-15T21:38:17.954ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3352024-11-15T21:38:17.964ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3362024-11-15T21:38:17.964ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool)
3372024-11-15T21:38:18.060ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }
3382024-11-15T21:38:18.068ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3392024-11-15T21:38:18.068ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3402024-11-15T21:38:18.068ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3412024-11-15T21:38:18.068ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3422024-11-15T21:38:18.068ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-15T21:38:18.068ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-15T21:38:18.068ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3452024-11-15T21:38:18.104ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3462024-11-15T21:38:18.114ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8601efa0-7d56-406c-bb55-59ecc862a206/crypt/zone file = sled-storage/src/dataset.rs:303
3472024-11-15T21:38:18.295ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8601efa0-7d56-406c-bb55-59ecc862a206 file = sled-storage/src/dataset.rs:389
3482024-11-15T21:38:18.303ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3492024-11-15T21:38:18.303ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3502024-11-15T21:38:18.303ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3512024-11-15T21:38:18.303ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3522024-11-15T21:38:18.303ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3532024-11-15T21:38:18.313ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3542024-11-15T21:38:18.313ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool)
3552024-11-15T21:38:18.409ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }
3562024-11-15T21:38:18.417ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3572024-11-15T21:38:18.417ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3582024-11-15T21:38:18.417ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3592024-11-15T21:38:18.417ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3602024-11-15T21:38:18.417ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3612024-11-15T21:38:18.417ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-15T21:38:18.417ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3632024-11-15T21:38:18.421ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
3642024-11-15T21:38:18.453ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3652024-11-15T21:38:18.461ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3554a27f-cc97-4d5f-b65f-742b39508465/crypt/zone file = sled-storage/src/dataset.rs:303
3662024-11-15T21:38:18.634ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3554a27f-cc97-4d5f-b65f-742b39508465 file = sled-storage/src/dataset.rs:389
3672024-11-15T21:38:18.643ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3682024-11-15T21:38:18.643ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3692024-11-15T21:38:18.643ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3702024-11-15T21:38:18.643ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3712024-11-15T21:38:18.643ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3722024-11-15T21:38:18.654ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3732024-11-15T21:38:18.654ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 85716c71-25b7-416c-85b5-8758a81c43ee (zpool)
3742024-11-15T21:38:18.749ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }
3752024-11-15T21:38:18.757ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3762024-11-15T21:38:18.757ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3772024-11-15T21:38:18.757ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3782024-11-15T21:38:18.757ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3792024-11-15T21:38:18.757ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-15T21:38:18.757ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-11-15T21:38:18.757ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3822024-11-15T21:38:18.793ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3832024-11-15T21:38:18.801ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_85716c71-25b7-416c-85b5-8758a81c43ee/crypt/zone file = sled-storage/src/dataset.rs:303
3842024-11-15T21:38:18.975ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_85716c71-25b7-416c-85b5-8758a81c43ee file = sled-storage/src/dataset.rs:389
3852024-11-15T21:38:18.983ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3862024-11-15T21:38:18.983ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3872024-11-15T21:38:18.983ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3882024-11-15T21:38:18.983ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3892024-11-15T21:38:18.983ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3902024-11-15T21:38:18.992ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3912024-11-15T21:38:18.993ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool)
3922024-11-15T21:38:19.085ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }
3932024-11-15T21:38:19.092ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3942024-11-15T21:38:19.092ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3952024-11-15T21:38:19.092ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3962024-11-15T21:38:19.092ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3972024-11-15T21:38:19.092ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-11-15T21:38:19.093ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-15T21:38:19.093ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4002024-11-15T21:38:19.128ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4012024-11-15T21:38:19.140ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_75d1b97e-8e16-4b27-ad0e-659366660685/crypt/zone file = sled-storage/src/dataset.rs:303
4022024-11-15T21:38:19.316ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_75d1b97e-8e16-4b27-ad0e-659366660685 file = sled-storage/src/dataset.rs:389
4032024-11-15T21:38:19.323ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4042024-11-15T21:38:19.323ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4052024-11-15T21:38:19.323ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4062024-11-15T21:38:19.323ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4072024-11-15T21:38:19.323ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4082024-11-15T21:38:19.333ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4092024-11-15T21:38:19.333ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool)
4102024-11-15T21:38:19.435ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }
4112024-11-15T21:38:19.444ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4122024-11-15T21:38:19.444ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4132024-11-15T21:38:19.444ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4142024-11-15T21:38:19.444ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4152024-11-15T21:38:19.444ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4162024-11-15T21:38:19.444ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-15T21:38:19.444ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4182024-11-15T21:38:19.450ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
4192024-11-15T21:38:19.483ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4202024-11-15T21:38:19.491ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c/crypt/zone file = sled-storage/src/dataset.rs:303
4212024-11-15T21:38:19.667ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c file = sled-storage/src/dataset.rs:389
4222024-11-15T21:38:19.675ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-11-15T21:38:19.675ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-11-15T21:38:19.675ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-11-15T21:38:19.675ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-11-15T21:38:19.675ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-11-15T21:38:19.684ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-11-15T21:38:19.684ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool)
4292024-11-15T21:38:19.777ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }
4302024-11-15T21:38:19.785ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4312024-11-15T21:38:19.785ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4322024-11-15T21:38:19.785ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4332024-11-15T21:38:19.785ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4342024-11-15T21:38:19.785ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-15T21:38:19.786ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-15T21:38:19.786ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4372024-11-15T21:38:19.819ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4382024-11-15T21:38:19.826ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_07f78be9-2bf1-4fec-908e-2af18da98913/crypt/zone file = sled-storage/src/dataset.rs:303
4392024-11-15T21:38:19.992ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_07f78be9-2bf1-4fec-908e-2af18da98913 file = sled-storage/src/dataset.rs:389
4402024-11-15T21:38:20.000ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4412024-11-15T21:38:20.000ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4422024-11-15T21:38:20.000ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4432024-11-15T21:38:20.000ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d51009ae-3f60-480d-999c-9e7ec880cfcb (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 032a36b9-170e-41b5-a8b4-ceca9af83895 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4442024-11-15T21:38:20.000ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4452024-11-15T21:38:20.000ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4462024-11-15T21:38:20.000ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4472024-11-15T21:38:20.001ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:888 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
4482024-11-15T21:38:20.001ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4492024-11-15T21:38:20.001ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:914 generation = Generation(1) sled_id = 78d47478-5af8-488d-89c5-11be23443b63
4502024-11-15T21:38:20.001ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:919 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
4512024-11-15T21:38:20.001ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:924 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
4522024-11-15T21:38:20.001ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 78d47478-5af8-488d-89c5-11be23443b63
4532024-11-15T21:38:20.001ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:930 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
4542024-11-15T21:38:20.001ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4552024-11-15T21:38:20.001ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:935 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
4562024-11-15T21:38:20.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4132880 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33604 req_id = e21497fc-2876-4edd-99c8-4b0bf48d1a53 response_code = 200 uri = /omicron-physical-disks
4572024-11-15T21:38:20.032ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {002c664f-9d0c-4e02-9e19-583e78215c8f (dataset): DatasetConfig { id: 002c664f-9d0c-4e02-9e19-583e78215c8f (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03eab9ea-af6a-45a5-959a-fabae0c0f8ef (dataset): DatasetConfig { id: 03eab9ea-af6a-45a5-959a-fabae0c0f8ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0769e4d2-0c18-49b1-ae2d-5923de81c59c (dataset): DatasetConfig { id: 0769e4d2-0c18-49b1-ae2d-5923de81c59c (dataset), name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0b735d2d-faa4-4368-8426-ca7bf2036788 (dataset): DatasetConfig { id: 0b735d2d-faa4-4368-8426-ca7bf2036788 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15b9e8a0-fb91-446f-ba3c-620fc28041e0 (dataset): DatasetConfig { id: 15b9e8a0-fb91-446f-ba3c-620fc28041e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18ccafd4-05d0-4232-a8b5-79c309aa56ef (dataset): DatasetConfig { id: 18ccafd4-05d0-4232-a8b5-79c309aa56ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e99672f-4266-4643-ba49-b6c1d79e7c40 (dataset): DatasetConfig { id: 1e99672f-4266-4643-ba49-b6c1d79e7c40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20294be3-04ba-45aa-bc0d-61d20bc03898 (dataset): DatasetConfig { id: 20294be3-04ba-45aa-bc0d-61d20bc03898 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22aafd65-9e76-45d2-92a6-6accf024b6f3 (dataset): DatasetConfig { id: 22aafd65-9e76-45d2-92a6-6accf024b6f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d7b7fd8-3e53-4e0a-b2ff-4aeddf549aaf (dataset): DatasetConfig { id: 2d7b7fd8-3e53-4e0a-b2ff-4aeddf549aaf (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 310ba5ef-17c6-4ad4-a83e-9ae2750aa3cc (dataset): DatasetConfig { id: 310ba5ef-17c6-4ad4-a83e-9ae2750aa3cc (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37300b0a-7d49-4468-bb9d-623127769f9c (dataset): DatasetConfig { id: 37300b0a-7d49-4468-bb9d-623127769f9c (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40daf617-755e-4785-9d8e-0d1068541731 (dataset): DatasetConfig { id: 40daf617-755e-4785-9d8e-0d1068541731 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41fb86a0-b156-4f0b-b673-b490ade472e0 (dataset): DatasetConfig { id: 41fb86a0-b156-4f0b-b673-b490ade472e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47e97ac6-1bc2-4511-9c41-efe10b9433ba (dataset): DatasetConfig { id: 47e97ac6-1bc2-4511-9c41-efe10b9433ba (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48fbe0cf-0add-4dcb-b53e-42d003fe7b7f (dataset): DatasetConfig { id: 48fbe0cf-0add-4dcb-b53e-42d003fe7b7f (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ef2f9d4-5f80-49b7-9268-ac25c4081041 (dataset): DatasetConfig { id: 4ef2f9d4-5f80-49b7-9268-ac25c4081041 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5409c6ce-c639-4431-b988-a7daacb5071a (dataset): DatasetConfig { id: 5409c6ce-c639-4431-b988-a7daacb5071a (dataset), name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57d56ff3-1caa-4dd0-b959-986d3253fd98 (dataset): DatasetConfig { id: 57d56ff3-1caa-4dd0-b959-986d3253fd98 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68542593-655e-49d9-a5f6-aa698540ce61 (dataset): DatasetConfig { id: 68542593-655e-49d9-a5f6-aa698540ce61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 695691ef-5a17-4d61-ab32-ebdfad26a653 (dataset): DatasetConfig { id: 695691ef-5a17-4d61-ab32-ebdfad26a653 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a8be94a-db25-492b-bcb9-965122e6bebb (dataset): DatasetConfig { id: 6a8be94a-db25-492b-bcb9-965122e6bebb (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6df97076-2cfd-4bde-90f3-06939ee600fc (dataset): DatasetConfig { id: 6df97076-2cfd-4bde-90f3-06939ee600fc (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7127ce20-aa72-4046-8e84-4570bff196b8 (dataset): DatasetConfig { id: 7127ce20-aa72-4046-8e84-4570bff196b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7365e14a-d86e-4d68-90e1-d44c73c67ce0 (dataset): DatasetConfig { id: 7365e14a-d86e-4d68-90e1-d44c73c67ce0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 798f27bf-052b-4952-aef0-4686f9903729 (dataset): DatasetConfig { id: 798f27bf-052b-4952-aef0-4686f9903729 (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c37463d-93b1-4dce-ae49-c39e5dc53e69 (dataset): DatasetConfig { id: 7c37463d-93b1-4dce-ae49-c39e5dc53e69 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85cec91a-61c7-4d5b-a1f6-5c7e74334236 (dataset): DatasetConfig { id: 85cec91a-61c7-4d5b-a1f6-5c7e74334236 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 862bb5ed-3c06-485d-a5e3-6f92ff0c7dba (dataset): DatasetConfig { id: 862bb5ed-3c06-485d-a5e3-6f92ff0c7dba (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 881de252-5121-4af1-a00e-ececfa1166ad (dataset): DatasetConfig { id: 881de252-5121-4af1-a00e-ececfa1166ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8918bd43-907f-4625-a97f-a7e1e54ee845 (dataset): DatasetConfig { id: 8918bd43-907f-4625-a97f-a7e1e54ee845 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89dc60ae-863e-4e04-af0c-6bd6fa573f66 (dataset): DatasetConfig { id: 89dc60ae-863e-4e04-af0c-6bd6fa573f66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 917434b7-4ace-4756-a66e-55d0eea3c91e (dataset): DatasetConfig { id: 917434b7-4ace-4756-a66e-55d0eea3c91e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91e0c3f5-50df-4f3b-84d3-e7cc69897749 (dataset): DatasetConfig { id: 91e0c3f5-50df-4f3b-84d3-e7cc69897749 (dataset), name: DatasetName { pool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 921b3188-56ca-4e90-ad80-7542e581e6fc (dataset): DatasetConfig { id: 921b3188-56ca-4e90-ad80-7542e581e6fc (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97e335c4-b0db-49ec-8138-0fe41c0971e8 (dataset): DatasetConfig { id: 97e335c4-b0db-49ec-8138-0fe41c0971e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97e91b94-baf0-47ce-822b-376703203737 (dataset): DatasetConfig { id: 97e91b94-baf0-47ce-822b-376703203737 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98c8f738-595e-46e4-843d-7dd1cc096e7b (dataset): DatasetConfig { id: 98c8f738-595e-46e4-843d-7dd1cc096e7b (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e1c04b7-6bf8-4d08-afe0-4b2803e7d547 (dataset): DatasetConfig { id: 9e1c04b7-6bf8-4d08-afe0-4b2803e7d547 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e275e53-9fb7-4ebc-beb4-209900382b6a (dataset): DatasetConfig { id: 9e275e53-9fb7-4ebc-beb4-209900382b6a (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e444d54-bd60-4c7a-be2f-c44d3bbf990c (dataset): DatasetConfig { id: 9e444d54-bd60-4c7a-be2f-c44d3bbf990c (dataset), name: DatasetName { pool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9f071816-a99d-43c3-aee2-c2fedce61abc (dataset): DatasetConfig { id: 9f071816-a99d-43c3-aee2-c2fedce61abc (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9f9be69a-3075-42bb-81af-3a826518c6a8 (dataset): DatasetConfig { id: 9f9be69a-3075-42bb-81af-3a826518c6a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fd98af0-91b3-4c66-afc0-9756bb27a6bc (dataset): DatasetConfig { id: 9fd98af0-91b3-4c66-afc0-9756bb27a6bc (dataset), name: DatasetName { pool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8d3f9e6-c4d8-46c8-b033-99f6d1f5c981 (dataset): DatasetConfig { id: a8d3f9e6-c4d8-46c8-b033-99f6d1f5c981 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aacc47d4-cdf2-4b10-98e5-1a9eb98303a7 (dataset): DatasetConfig { id: aacc47d4-cdf2-4b10-98e5-1a9eb98303a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, abbe876c-874d-4332-8212-1581a7789d55 (dataset): DatasetConfig { id: abbe876c-874d-4332-8212-1581a7789d55 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6962b77-121c-4c16-aa91-68479013307a (dataset): DatasetConfig { id: b6962b77-121c-4c16-aa91-68479013307a (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b73bb9c5-5b3a-4a3a-93ea-16b48f720ff3 (dataset): DatasetConfig { id: b73bb9c5-5b3a-4a3a-93ea-16b48f720ff3 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba524577-0b43-43e6-90dc-dd0c3d68eb5a (dataset): DatasetConfig { id: ba524577-0b43-43e6-90dc-dd0c3d68eb5a (dataset), name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, baa27337-ced6-4d8b-aeec-58750ca0c99d (dataset): DatasetConfig { id: baa27337-ced6-4d8b-aeec-58750ca0c99d (dataset), name: DatasetName { pool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bd5836ec-95f3-432f-b67e-558cdf9ea3c7 (dataset): DatasetConfig { id: bd5836ec-95f3-432f-b67e-558cdf9ea3c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, be48a84d-67d3-460c-a511-c187ddc9c829 (dataset): DatasetConfig { id: be48a84d-67d3-460c-a511-c187ddc9c829 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c813a90b-d91c-4c2e-976f-344a0c5ace33 (dataset): DatasetConfig { id: c813a90b-d91c-4c2e-976f-344a0c5ace33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca04515f-5972-42b9-9a30-ba0a6fc3ed45 (dataset): DatasetConfig { id: ca04515f-5972-42b9-9a30-ba0a6fc3ed45 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca3d866d-c95f-46fb-8968-84e190f3c0fb (dataset): DatasetConfig { id: ca3d866d-c95f-46fb-8968-84e190f3c0fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, caffa814-d0f8-4f5e-88ad-dbcf7cdf772d (dataset): DatasetConfig { id: caffa814-d0f8-4f5e-88ad-dbcf7cdf772d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf6c0613-1538-432f-8249-75f6a2632f11 (dataset): DatasetConfig { id: cf6c0613-1538-432f-8249-75f6a2632f11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d50795e5-1498-45d7-b530-c28460082bde (dataset): DatasetConfig { id: d50795e5-1498-45d7-b530-c28460082bde (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da33fea6-f87d-47c1-90c5-280fcf1b0b2f (dataset): DatasetConfig { id: da33fea6-f87d-47c1-90c5-280fcf1b0b2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dd52f72b-ae2f-4ab4-b18c-278cfa61c5d4 (dataset): DatasetConfig { id: dd52f72b-ae2f-4ab4-b18c-278cfa61c5d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6c9af7a-8c8a-4864-97a4-ffdc28bac6bc (dataset): DatasetConfig { id: e6c9af7a-8c8a-4864-97a4-ffdc28bac6bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eaecbc1d-35f5-4c3f-9e3c-e3fd69b9cbbb (dataset): DatasetConfig { id: eaecbc1d-35f5-4c3f-9e3c-e3fd69b9cbbb (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f2fae4e9-c4bc-4bf5-bef9-d53e8904beef (dataset): DatasetConfig { id: f2fae4e9-c4bc-4bf5-bef9-d53e8904beef (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe081c94-ab4c-4648-a3dd-d4efb2eb3ac5 (dataset): DatasetConfig { id: fe081c94-ab4c-4648-a3dd-d4efb2eb3ac5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff1f4425-88db-4123-94ac-ffad5ac2dd13 (dataset): DatasetConfig { id: ff1f4425-88db-4123-94ac-ffad5ac2dd13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4582024-11-15T21:38:20.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47348
4592024-11-15T21:38:20.033ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:850 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
4602024-11-15T21:38:20.033ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {002c664f-9d0c-4e02-9e19-583e78215c8f (dataset): DatasetConfig { id: 002c664f-9d0c-4e02-9e19-583e78215c8f (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03eab9ea-af6a-45a5-959a-fabae0c0f8ef (dataset): DatasetConfig { id: 03eab9ea-af6a-45a5-959a-fabae0c0f8ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0769e4d2-0c18-49b1-ae2d-5923de81c59c (dataset): DatasetConfig { id: 0769e4d2-0c18-49b1-ae2d-5923de81c59c (dataset), name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0b735d2d-faa4-4368-8426-ca7bf2036788 (dataset): DatasetConfig { id: 0b735d2d-faa4-4368-8426-ca7bf2036788 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15b9e8a0-fb91-446f-ba3c-620fc28041e0 (dataset): DatasetConfig { id: 15b9e8a0-fb91-446f-ba3c-620fc28041e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18ccafd4-05d0-4232-a8b5-79c309aa56ef (dataset): DatasetConfig { id: 18ccafd4-05d0-4232-a8b5-79c309aa56ef (dataset), name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e99672f-4266-4643-ba49-b6c1d79e7c40 (dataset): DatasetConfig { id: 1e99672f-4266-4643-ba49-b6c1d79e7c40 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20294be3-04ba-45aa-bc0d-61d20bc03898 (dataset): DatasetConfig { id: 20294be3-04ba-45aa-bc0d-61d20bc03898 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22aafd65-9e76-45d2-92a6-6accf024b6f3 (dataset): DatasetConfig { id: 22aafd65-9e76-45d2-92a6-6accf024b6f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d7b7fd8-3e53-4e0a-b2ff-4aeddf549aaf (dataset): DatasetConfig { id: 2d7b7fd8-3e53-4e0a-b2ff-4aeddf549aaf (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 310ba5ef-17c6-4ad4-a83e-9ae2750aa3cc (dataset): DatasetConfig { id: 310ba5ef-17c6-4ad4-a83e-9ae2750aa3cc (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37300b0a-7d49-4468-bb9d-623127769f9c (dataset): DatasetConfig { id: 37300b0a-7d49-4468-bb9d-623127769f9c (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40daf617-755e-4785-9d8e-0d1068541731 (dataset): DatasetConfig { id: 40daf617-755e-4785-9d8e-0d1068541731 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41fb86a0-b156-4f0b-b673-b490ade472e0 (dataset): DatasetConfig { id: 41fb86a0-b156-4f0b-b673-b490ade472e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47e97ac6-1bc2-4511-9c41-efe10b9433ba (dataset): DatasetConfig { id: 47e97ac6-1bc2-4511-9c41-efe10b9433ba (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48fbe0cf-0add-4dcb-b53e-42d003fe7b7f (dataset): DatasetConfig { id: 48fbe0cf-0add-4dcb-b53e-42d003fe7b7f (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ef2f9d4-5f80-49b7-9268-ac25c4081041 (dataset): DatasetConfig { id: 4ef2f9d4-5f80-49b7-9268-ac25c4081041 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5409c6ce-c639-4431-b988-a7daacb5071a (dataset): DatasetConfig { id: 5409c6ce-c639-4431-b988-a7daacb5071a (dataset), name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57d56ff3-1caa-4dd0-b959-986d3253fd98 (dataset): DatasetConfig { id: 57d56ff3-1caa-4dd0-b959-986d3253fd98 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68542593-655e-49d9-a5f6-aa698540ce61 (dataset): DatasetConfig { id: 68542593-655e-49d9-a5f6-aa698540ce61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 695691ef-5a17-4d61-ab32-ebdfad26a653 (dataset): DatasetConfig { id: 695691ef-5a17-4d61-ab32-ebdfad26a653 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a8be94a-db25-492b-bcb9-965122e6bebb (dataset): DatasetConfig { id: 6a8be94a-db25-492b-bcb9-965122e6bebb (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6df97076-2cfd-4bde-90f3-06939ee600fc (dataset): DatasetConfig { id: 6df97076-2cfd-4bde-90f3-06939ee600fc (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7127ce20-aa72-4046-8e84-4570bff196b8 (dataset): DatasetConfig { id: 7127ce20-aa72-4046-8e84-4570bff196b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7365e14a-d86e-4d68-90e1-d44c73c67ce0 (dataset): DatasetConfig { id: 7365e14a-d86e-4d68-90e1-d44c73c67ce0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 798f27bf-052b-4952-aef0-4686f9903729 (dataset): DatasetConfig { id: 798f27bf-052b-4952-aef0-4686f9903729 (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c37463d-93b1-4dce-ae49-c39e5dc53e69 (dataset): DatasetConfig { id: 7c37463d-93b1-4dce-ae49-c39e5dc53e69 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85cec91a-61c7-4d5b-a1f6-5c7e74334236 (dataset): DatasetConfig { id: 85cec91a-61c7-4d5b-a1f6-5c7e74334236 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 862bb5ed-3c06-485d-a5e3-6f92ff0c7dba (dataset): DatasetConfig { id: 862bb5ed-3c06-485d-a5e3-6f92ff0c7dba (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 881de252-5121-4af1-a00e-ececfa1166ad (dataset): DatasetConfig { id: 881de252-5121-4af1-a00e-ececfa1166ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8918bd43-907f-4625-a97f-a7e1e54ee845 (dataset): DatasetConfig { id: 8918bd43-907f-4625-a97f-a7e1e54ee845 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89dc60ae-863e-4e04-af0c-6bd6fa573f66 (dataset): DatasetConfig { id: 89dc60ae-863e-4e04-af0c-6bd6fa573f66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 917434b7-4ace-4756-a66e-55d0eea3c91e (dataset): DatasetConfig { id: 917434b7-4ace-4756-a66e-55d0eea3c91e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91e0c3f5-50df-4f3b-84d3-e7cc69897749 (dataset): DatasetConfig { id: 91e0c3f5-50df-4f3b-84d3-e7cc69897749 (dataset), name: DatasetName { pool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 921b3188-56ca-4e90-ad80-7542e581e6fc (dataset): DatasetConfig { id: 921b3188-56ca-4e90-ad80-7542e581e6fc (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97e335c4-b0db-49ec-8138-0fe41c0971e8 (dataset): DatasetConfig { id: 97e335c4-b0db-49ec-8138-0fe41c0971e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97e91b94-baf0-47ce-822b-376703203737 (dataset): DatasetConfig { id: 97e91b94-baf0-47ce-822b-376703203737 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98c8f738-595e-46e4-843d-7dd1cc096e7b (dataset): DatasetConfig { id: 98c8f738-595e-46e4-843d-7dd1cc096e7b (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e1c04b7-6bf8-4d08-afe0-4b2803e7d547 (dataset): DatasetConfig { id: 9e1c04b7-6bf8-4d08-afe0-4b2803e7d547 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e275e53-9fb7-4ebc-beb4-209900382b6a (dataset): DatasetConfig { id: 9e275e53-9fb7-4ebc-beb4-209900382b6a (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e444d54-bd60-4c7a-be2f-c44d3bbf990c (dataset): DatasetConfig { id: 9e444d54-bd60-4c7a-be2f-c44d3bbf990c (dataset), name: DatasetName { pool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9f071816-a99d-43c3-aee2-c2fedce61abc (dataset): DatasetConfig { id: 9f071816-a99d-43c3-aee2-c2fedce61abc (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9f9be69a-3075-42bb-81af-3a826518c6a8 (dataset): DatasetConfig { id: 9f9be69a-3075-42bb-81af-3a826518c6a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fd98af0-91b3-4c66-afc0-9756bb27a6bc (dataset): DatasetConfig { id: 9fd98af0-91b3-4c66-afc0-9756bb27a6bc (dataset), name: DatasetName { pool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8d3f9e6-c4d8-46c8-b033-99f6d1f5c981 (dataset): DatasetConfig { id: a8d3f9e6-c4d8-46c8-b033-99f6d1f5c981 (dataset), name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aacc47d4-cdf2-4b10-98e5-1a9eb98303a7 (dataset): DatasetConfig { id: aacc47d4-cdf2-4b10-98e5-1a9eb98303a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, abbe876c-874d-4332-8212-1581a7789d55 (dataset): DatasetConfig { id: abbe876c-874d-4332-8212-1581a7789d55 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6962b77-121c-4c16-aa91-68479013307a (dataset): DatasetConfig { id: b6962b77-121c-4c16-aa91-68479013307a (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b73bb9c5-5b3a-4a3a-93ea-16b48f720ff3 (dataset): DatasetConfig { id: b73bb9c5-5b3a-4a3a-93ea-16b48f720ff3 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba524577-0b43-43e6-90dc-dd0c3d68eb5a (dataset): DatasetConfig { id: ba524577-0b43-43e6-90dc-dd0c3d68eb5a (dataset), name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, baa27337-ced6-4d8b-aeec-58750ca0c99d (dataset): DatasetConfig { id: baa27337-ced6-4d8b-aeec-58750ca0c99d (dataset), name: DatasetName { pool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bd5836ec-95f3-432f-b67e-558cdf9ea3c7 (dataset): DatasetConfig { id: bd5836ec-95f3-432f-b67e-558cdf9ea3c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, be48a84d-67d3-460c-a511-c187ddc9c829 (dataset): DatasetConfig { id: be48a84d-67d3-460c-a511-c187ddc9c829 (dataset), name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c813a90b-d91c-4c2e-976f-344a0c5ace33 (dataset): DatasetConfig { id: c813a90b-d91c-4c2e-976f-344a0c5ace33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca04515f-5972-42b9-9a30-ba0a6fc3ed45 (dataset): DatasetConfig { id: ca04515f-5972-42b9-9a30-ba0a6fc3ed45 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca3d866d-c95f-46fb-8968-84e190f3c0fb (dataset): DatasetConfig { id: ca3d866d-c95f-46fb-8968-84e190f3c0fb (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, caffa814-d0f8-4f5e-88ad-dbcf7cdf772d (dataset): DatasetConfig { id: caffa814-d0f8-4f5e-88ad-dbcf7cdf772d (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf6c0613-1538-432f-8249-75f6a2632f11 (dataset): DatasetConfig { id: cf6c0613-1538-432f-8249-75f6a2632f11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d50795e5-1498-45d7-b530-c28460082bde (dataset): DatasetConfig { id: d50795e5-1498-45d7-b530-c28460082bde (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da33fea6-f87d-47c1-90c5-280fcf1b0b2f (dataset): DatasetConfig { id: da33fea6-f87d-47c1-90c5-280fcf1b0b2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dd52f72b-ae2f-4ab4-b18c-278cfa61c5d4 (dataset): DatasetConfig { id: dd52f72b-ae2f-4ab4-b18c-278cfa61c5d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6c9af7a-8c8a-4864-97a4-ffdc28bac6bc (dataset): DatasetConfig { id: e6c9af7a-8c8a-4864-97a4-ffdc28bac6bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eaecbc1d-35f5-4c3f-9e3c-e3fd69b9cbbb (dataset): DatasetConfig { id: eaecbc1d-35f5-4c3f-9e3c-e3fd69b9cbbb (dataset), name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f2fae4e9-c4bc-4bf5-bef9-d53e8904beef (dataset): DatasetConfig { id: f2fae4e9-c4bc-4bf5-bef9-d53e8904beef (dataset), name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe081c94-ab4c-4648-a3dd-d4efb2eb3ac5 (dataset): DatasetConfig { id: fe081c94-ab4c-4648-a3dd-d4efb2eb3ac5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff1f4425-88db-4123-94ac-ffad5ac2dd13 (dataset): DatasetConfig { id: ff1f4425-88db-4123-94ac-ffad5ac2dd13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4612024-11-15T21:38:20.033ZINFOSledAgent (StorageManager): No ledger in /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4622024-11-15T21:38:20.033ZINFOSledAgent (StorageManager): No ledger in /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4632024-11-15T21:38:20.033ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4642024-11-15T21:38:20.033ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-11-15T21:38:20.033ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crucible" } file = sled-storage/src/manager.rs:1331
4662024-11-15T21:38:20.122ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4672024-11-15T21:38:20.123ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8601efa0-7d56-406c-bb55-59ecc862a206/crypt/debug"), full_name: "oxp_8601efa0-7d56-406c-bb55-59ecc862a206/crypt/debug" } file = sled-storage/src/manager.rs:1331
4682024-11-15T21:38:20.192ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-11-15T21:38:20.192ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/85716c71-25b7-416c-85b5-8758a81c43ee/crypt/debug"), full_name: "oxp_85716c71-25b7-416c-85b5-8758a81c43ee/crypt/debug" } file = sled-storage/src/manager.rs:1331
4702024-11-15T21:38:20.258ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-11-15T21:38:20.258ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4722024-11-15T21:38:20.349ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4732024-11-15T21:38:20.349ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/zone"), full_name: "oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/zone" } file = sled-storage/src/manager.rs:1331
4742024-11-15T21:38:20.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4752024-11-15T21:38:20.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_75d1b97e-8e16-4b27-ad0e-659366660685/crucible" } file = sled-storage/src/manager.rs:1331
4762024-11-15T21:38:20.452ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
4772024-11-15T21:38:20.503ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-11-15T21:38:20.503ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3554a27f-cc97-4d5f-b65f-742b39508465/crypt/zone/oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df"), full_name: "oxp_3554a27f-cc97-4d5f-b65f-742b39508465/crypt/zone/oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df" } file = sled-storage/src/manager.rs:1331
4792024-11-15T21:38:20.576ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 21.563332635s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
4802024-11-15T21:38:20.603ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4812024-11-15T21:38:20.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8601efa0-7d56-406c-bb55-59ecc862a206/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4822024-11-15T21:38:20.692ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4832024-11-15T21:38:20.692ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/zone/oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9"), full_name: "oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/zone/oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9" } file = sled-storage/src/manager.rs:1331
4842024-11-15T21:38:20.793ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852024-11-15T21:38:20.793ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df" } file = sled-storage/src/manager.rs:1331
4862024-11-15T21:38:20.890ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4872024-11-15T21:38:20.890ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4882024-11-15T21:38:20.978ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4892024-11-15T21:38:20.978ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4902024-11-15T21:38:21.069ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-11-15T21:38:21.069ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3554a27f-cc97-4d5f-b65f-742b39508465/crucible" } file = sled-storage/src/manager.rs:1331
4922024-11-15T21:38:21.159ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-11-15T21:38:21.159ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77" } file = sled-storage/src/manager.rs:1331
4942024-11-15T21:38:21.261ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-11-15T21:38:21.261ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4962024-11-15T21:38:21.351ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-11-15T21:38:21.351ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone" } file = sled-storage/src/manager.rs:1331
4982024-11-15T21:38:21.419ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-11-15T21:38:21.419ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5002024-11-15T21:38:21.455ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
5012024-11-15T21:38:21.508ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5022024-11-15T21:38:21.508ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/85716c71-25b7-416c-85b5-8758a81c43ee/crypt/zone/oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a"), full_name: "oxp_85716c71-25b7-416c-85b5-8758a81c43ee/crypt/zone/oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a" } file = sled-storage/src/manager.rs:1331
5032024-11-15T21:38:21.603ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5042024-11-15T21:38:21.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd93eebe-c68d-4a35-bc8a-81c378c9224c/crypt/zone/oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd"), full_name: "oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c/crypt/zone/oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd" } file = sled-storage/src/manager.rs:1331
5052024-11-15T21:38:21.700ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5062024-11-15T21:38:21.700ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/75d1b97e-8e16-4b27-ad0e-659366660685/crypt/zone"), full_name: "oxp_75d1b97e-8e16-4b27-ad0e-659366660685/crypt/zone" } file = sled-storage/src/manager.rs:1331
5072024-11-15T21:38:21.768ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5082024-11-15T21:38:21.768ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/85716c71-25b7-416c-85b5-8758a81c43ee/crypt/zone"), full_name: "oxp_85716c71-25b7-416c-85b5-8758a81c43ee/crypt/zone" } file = sled-storage/src/manager.rs:1331
5092024-11-15T21:38:21.835ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5102024-11-15T21:38:21.835ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3554a27f-cc97-4d5f-b65f-742b39508465/crypt/zone/oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea"), full_name: "oxp_3554a27f-cc97-4d5f-b65f-742b39508465/crypt/zone/oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea" } file = sled-storage/src/manager.rs:1331
5112024-11-15T21:38:21.934ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5122024-11-15T21:38:21.934ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876/crucible" } file = sled-storage/src/manager.rs:1331
5132024-11-15T21:38:22.024ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5142024-11-15T21:38:22.024ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3554a27f-cc97-4d5f-b65f-742b39508465/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5152024-11-15T21:38:22.115ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5162024-11-15T21:38:22.115ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/zone/oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13"), full_name: "oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/zone/oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13" } file = sled-storage/src/manager.rs:1331
5172024-11-15T21:38:22.217ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-11-15T21:38:22.217ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/zone/oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3"), full_name: "oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/zone/oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3" } file = sled-storage/src/manager.rs:1331
5192024-11-15T21:38:22.314ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-11-15T21:38:22.314ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5212024-11-15T21:38:22.404ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-11-15T21:38:22.404ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/zone/oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100"), full_name: "oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/zone/oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100" } file = sled-storage/src/manager.rs:1331
5232024-11-15T21:38:22.460ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
5242024-11-15T21:38:22.504ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5252024-11-15T21:38:22.504ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/zone"), full_name: "oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/zone" } file = sled-storage/src/manager.rs:1331
5262024-11-15T21:38:22.572ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5272024-11-15T21:38:22.572ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8601efa0-7d56-406c-bb55-59ecc862a206/crypt/zone/oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1"), full_name: "oxp_8601efa0-7d56-406c-bb55-59ecc862a206/crypt/zone/oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1" } file = sled-storage/src/manager.rs:1331
5282024-11-15T21:38:22.672ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5292024-11-15T21:38:22.672ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd93eebe-c68d-4a35-bc8a-81c378c9224c/crypt/zone"), full_name: "oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c/crypt/zone" } file = sled-storage/src/manager.rs:1331
5302024-11-15T21:38:22.739ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5312024-11-15T21:38:22.739ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3554a27f-cc97-4d5f-b65f-742b39508465/crypt/zone/oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4"), full_name: "oxp_3554a27f-cc97-4d5f-b65f-742b39508465/crypt/zone/oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4" } file = sled-storage/src/manager.rs:1331
5322024-11-15T21:38:22.837ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5332024-11-15T21:38:22.838ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8601efa0-7d56-406c-bb55-59ecc862a206/crypt/zone/oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48"), full_name: "oxp_8601efa0-7d56-406c-bb55-59ecc862a206/crypt/zone/oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48" } file = sled-storage/src/manager.rs:1331
5342024-11-15T21:38:22.937ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5352024-11-15T21:38:22.937ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/07f78be9-2bf1-4fec-908e-2af18da98913/crypt/zone"), full_name: "oxp_07f78be9-2bf1-4fec-908e-2af18da98913/crypt/zone" } file = sled-storage/src/manager.rs:1331
5362024-11-15T21:38:23.005ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5372024-11-15T21:38:23.005ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8601efa0-7d56-406c-bb55-59ecc862a206/crypt/zone"), full_name: "oxp_8601efa0-7d56-406c-bb55-59ecc862a206/crypt/zone" } file = sled-storage/src/manager.rs:1331
5382024-11-15T21:38:23.073ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5392024-11-15T21:38:23.073ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3554a27f-cc97-4d5f-b65f-742b39508465/crypt/zone/oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4"), full_name: "oxp_3554a27f-cc97-4d5f-b65f-742b39508465/crypt/zone/oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4" } file = sled-storage/src/manager.rs:1331
5402024-11-15T21:38:23.176ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-11-15T21:38:23.176ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778" } file = sled-storage/src/manager.rs:1331
5422024-11-15T21:38:23.276ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-11-15T21:38:23.276ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f" } file = sled-storage/src/manager.rs:1331
5442024-11-15T21:38:23.375ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-11-15T21:38:23.375ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e" } file = sled-storage/src/manager.rs:1331
5462024-11-15T21:38:23.464ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
5472024-11-15T21:38:23.473ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5482024-11-15T21:38:23.473ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651" } file = sled-storage/src/manager.rs:1331
5492024-11-15T21:38:23.572ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5502024-11-15T21:38:23.572ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/07f78be9-2bf1-4fec-908e-2af18da98913/crypt/debug"), full_name: "oxp_07f78be9-2bf1-4fec-908e-2af18da98913/crypt/debug" } file = sled-storage/src/manager.rs:1331
5512024-11-15T21:38:23.640ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-11-15T21:38:23.640ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/debug"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/debug" } file = sled-storage/src/manager.rs:1331
5532024-11-15T21:38:23.708ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-11-15T21:38:23.708ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/zone/oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c"), full_name: "oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/zone/oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c" } file = sled-storage/src/manager.rs:1331
5552024-11-15T21:38:23.808ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-11-15T21:38:23.808ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c/crucible" } file = sled-storage/src/manager.rs:1331
5572024-11-15T21:38:23.897ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5582024-11-15T21:38:23.897ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/75d1b97e-8e16-4b27-ad0e-659366660685/crypt/zone/oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c"), full_name: "oxp_75d1b97e-8e16-4b27-ad0e-659366660685/crypt/zone/oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c" } file = sled-storage/src/manager.rs:1331
5592024-11-15T21:38:23.997ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5602024-11-15T21:38:23.997ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_07f78be9-2bf1-4fec-908e-2af18da98913/crucible" } file = sled-storage/src/manager.rs:1331
5612024-11-15T21:38:24.087ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5622024-11-15T21:38:24.087ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb" } file = sled-storage/src/manager.rs:1331
5632024-11-15T21:38:24.186ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-11-15T21:38:24.186ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5652024-11-15T21:38:24.276ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-11-15T21:38:24.276ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5672024-11-15T21:38:24.379ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-11-15T21:38:24.379ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/75d1b97e-8e16-4b27-ad0e-659366660685/crypt/zone/oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867"), full_name: "oxp_75d1b97e-8e16-4b27-ad0e-659366660685/crypt/zone/oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867" } file = sled-storage/src/manager.rs:1331
5692024-11-15T21:38:24.467ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
5702024-11-15T21:38:24.481ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5712024-11-15T21:38:24.481ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd93eebe-c68d-4a35-bc8a-81c378c9224c/crypt/debug"), full_name: "oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c/crypt/debug" } file = sled-storage/src/manager.rs:1331
5722024-11-15T21:38:24.553ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5732024-11-15T21:38:24.553ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/debug"), full_name: "oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/debug" } file = sled-storage/src/manager.rs:1331
5742024-11-15T21:38:24.625ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5752024-11-15T21:38:24.625ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095"), full_name: "oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/zone/oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095" } file = sled-storage/src/manager.rs:1331
5762024-11-15T21:38:24.722ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772024-11-15T21:38:24.722ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_85716c71-25b7-416c-85b5-8758a81c43ee/crucible" } file = sled-storage/src/manager.rs:1331
5782024-11-15T21:38:24.809ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5792024-11-15T21:38:24.809ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5802024-11-15T21:38:24.897ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5812024-11-15T21:38:24.897ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crucible" } file = sled-storage/src/manager.rs:1331
5822024-11-15T21:38:24.983ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5832024-11-15T21:38:24.983ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8601efa0-7d56-406c-bb55-59ecc862a206/crypt/zone/oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e"), full_name: "oxp_8601efa0-7d56-406c-bb55-59ecc862a206/crypt/zone/oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e" } file = sled-storage/src/manager.rs:1331
5842024-11-15T21:38:25.084ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-11-15T21:38:25.084ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3554a27f-cc97-4d5f-b65f-742b39508465/crypt/debug"), full_name: "oxp_3554a27f-cc97-4d5f-b65f-742b39508465/crypt/debug" } file = sled-storage/src/manager.rs:1331
5862024-11-15T21:38:25.152ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5872024-11-15T21:38:25.152ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/zone/oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2"), full_name: "oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/zone/oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2" } file = sled-storage/src/manager.rs:1331
5882024-11-15T21:38:25.256ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5892024-11-15T21:38:25.256ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/75d1b97e-8e16-4b27-ad0e-659366660685/crypt/debug"), full_name: "oxp_75d1b97e-8e16-4b27-ad0e-659366660685/crypt/debug" } file = sled-storage/src/manager.rs:1331
5902024-11-15T21:38:25.285ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15394789484286491604 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
5912024-11-15T21:38:25.286ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4893672133155549866 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
5922024-11-15T21:38:25.325ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5932024-11-15T21:38:25.325ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/07f78be9-2bf1-4fec-908e-2af18da98913/crypt/zone/oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18"), full_name: "oxp_07f78be9-2bf1-4fec-908e-2af18da98913/crypt/zone/oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18" } file = sled-storage/src/manager.rs:1331
5942024-11-15T21:38:25.424ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5952024-11-15T21:38:25.424ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/85716c71-25b7-416c-85b5-8758a81c43ee/crypt/zone/oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254"), full_name: "oxp_85716c71-25b7-416c-85b5-8758a81c43ee/crypt/zone/oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254" } file = sled-storage/src/manager.rs:1331
5962024-11-15T21:38:25.469ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
5972024-11-15T21:38:25.522ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5982024-11-15T21:38:25.522ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/debug"), full_name: "oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/debug" } file = sled-storage/src/manager.rs:1331
5992024-11-15T21:38:25.592ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6002024-11-15T21:38:25.592ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3554a27f-cc97-4d5f-b65f-742b39508465/crypt/zone"), full_name: "oxp_3554a27f-cc97-4d5f-b65f-742b39508465/crypt/zone" } file = sled-storage/src/manager.rs:1331
6012024-11-15T21:38:25.661ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6022024-11-15T21:38:25.661ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8601efa0-7d56-406c-bb55-59ecc862a206/crucible" } file = sled-storage/src/manager.rs:1331
6032024-11-15T21:38:25.666ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
6042024-11-15T21:38:25.666ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
6052024-11-15T21:38:25.672ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
6062024-11-15T21:38:25.672ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
6072024-11-15T21:38:25.760ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6082024-11-15T21:38:25.760ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/zone/oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0"), full_name: "oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/zone/oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0" } file = sled-storage/src/manager.rs:1331
6092024-11-15T21:38:25.816ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6102024-11-15T21:38:25.816ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6112024-11-15T21:38:25.856ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6122024-11-15T21:38:25.856ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6132024-11-15T21:38:25.868ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6142024-11-15T21:38:25.869ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6152024-11-15T21:38:25.870ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:852 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
6162024-11-15T21:38:25.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5837420 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47348 req_id = c3fe2f52-d749-416b-bb5c-61d032e4f92d response_code = 200 uri = /datasets
6172024-11-15T21:38:25.905ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6182024-11-15T21:38:25.905ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6192024-11-15T21:38:25.918ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: edd0c7a0-e093-44a9-845e-02d5df012651 (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2 (service), filesystem_pool: Some(ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 457f990d-f83f-40bb-8721-4e2b5314e3a3 (service), filesystem_pool: Some(ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6202024-11-15T21:38:25.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44978
6212024-11-15T21:38:25.919ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edd0c7a0-e093-44a9-845e-02d5df012651, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6222024-11-15T21:38:25.919ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edd0c7a0-e093-44a9-845e-02d5df012651, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6232024-11-15T21:38:25.923ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6242024-11-15T21:38:25.923ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6252024-11-15T21:38:25.956ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6262024-11-15T21:38:25.956ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6272024-11-15T21:38:25.990ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 457f990d-f83f-40bb-8721-4e2b5314e3a3, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6282024-11-15T21:38:25.990ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 457f990d-f83f-40bb-8721-4e2b5314e3a3, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6292024-11-15T21:38:25.993ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6302024-11-15T21:38:25.993ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6312024-11-15T21:38:26.028ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6322024-11-15T21:38:26.028ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:188
6332024-11-15T21:38:26.028ZINFOSledAgent (ServiceManager): No ledger in /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:188
6342024-11-15T21:38:26.028ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6352024-11-15T21:38:26.081ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6362024-11-15T21:38:26.081ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6372024-11-15T21:38:26.081ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6382024-11-15T21:38:26.093ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6392024-11-15T21:38:26.093ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6402024-11-15T21:38:26.137ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2 file = illumos-utils/src/zone.rs:325
6412024-11-15T21:38:26.141ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3 file = illumos-utils/src/zone.rs:325
6422024-11-15T21:38:26.146ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651 file = illumos-utils/src/zone.rs:325
6432024-11-15T21:38:26.153ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6442024-11-15T21:38:26.154ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/nexus.rs:527 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
6452024-11-15T21:38:26.157ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2 file = illumos-utils/src/zone.rs:363
6462024-11-15T21:38:26.162ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3 file = illumos-utils/src/zone.rs:363
6472024-11-15T21:38:26.166ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651 file = illumos-utils/src/zone.rs:363
6482024-11-15T21:38:26.194ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6492024-11-15T21:38:26.194ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6502024-11-15T21:38:26.194ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
6512024-11-15T21:38:26.194ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6522024-11-15T21:38:26.232ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6532024-11-15T21:38:26.296ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6542024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6552024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6562024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6572024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6582024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6592024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6602024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6612024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6622024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6632024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6642024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6652024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6662024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6672024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6682024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6692024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6702024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6712024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6722024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6732024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6742024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6752024-11-15T21:38:26.296ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6762024-11-15T21:38:26.471ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
6772024-11-15T21:38:26.769ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
6782024-11-15T21:38:26.769ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
6792024-11-15T21:38:27.764ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-11-15T21:38:27.765ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6812024-11-15T21:38:28.240ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822024-11-15T21:38:28.717ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-11-15T21:38:28.717ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6842024-11-15T21:38:28.717ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651
6852024-11-15T21:38:28.722ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6862024-11-15T21:38:28.722ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
6872024-11-15T21:38:28.726ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3
6882024-11-15T21:38:28.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2") failed: Property not found. retry in 27.293377ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
6892024-11-15T21:38:28.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3") failed: Property not found. retry in 53.164351ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3
6902024-11-15T21:38:28.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651") failed: Property not found. retry in 63.814268ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651
6912024-11-15T21:38:28.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2") failed: Property not found. retry in 121.595398ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
6922024-11-15T21:38:29.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3") failed: Property not found. retry in 93.894497ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3
6932024-11-15T21:38:29.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2") failed: Property not found. retry in 158.487432ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
6942024-11-15T21:38:29.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651") failed: Property not found. retry in 125.896914ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651
6952024-11-15T21:38:29.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3") failed: Property not found. retry in 197.956184ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3
6962024-11-15T21:38:29.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651") failed: Property not found. retry in 297.268173ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651
6972024-11-15T21:38:29.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2") failed: Property not found. retry in 581.211222ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
6982024-11-15T21:38:29.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3") failed: Property not found. retry in 462.583893ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3
6992024-11-15T21:38:29.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651") failed: Property not found. retry in 311.733571ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651
7002024-11-15T21:38:30.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651") failed: Property not found. retry in 620.874396ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651
7012024-11-15T21:38:30.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3") failed: Property not found. retry in 983.948786ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3
7022024-11-15T21:38:30.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2") failed: Property not found. retry in 781.83065ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
7032024-11-15T21:38:30.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651") failed: Property not found. retry in 541.239535ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651
7042024-11-15T21:38:30.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2") failed: Property not found. retry in 595.098018ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
7052024-11-15T21:38:31.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3") failed: Property not found. retry in 691.879572ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3
7062024-11-15T21:38:31.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651") failed: Property not found. retry in 1.320386209s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651
7072024-11-15T21:38:31.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2") failed: Property not found. retry in 780.811197ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
7082024-11-15T21:38:31.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3") failed: Property not found. retry in 1.266596002s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3
7092024-11-15T21:38:32.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2") failed: Property not found. retry in 857.571077ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
7102024-11-15T21:38:32.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651") failed: Property not found. retry in 1.187592661s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651
7112024-11-15T21:38:33.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3") failed: Property not found. retry in 1.276903079s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3
7122024-11-15T21:38:33.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2") failed: Property not found. retry in 1.046088222s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
7132024-11-15T21:38:33.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651") failed: Property not found. retry in 687.86835ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651
7142024-11-15T21:38:34.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2") failed: Property not found. retry in 554.519301ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
7152024-11-15T21:38:34.809ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_5804ddd8-8ad1-42d2-89d7-fdb66142b4f2
7162024-11-15T21:38:34.809ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_457f990d-f83f-40bb-8721-4e2b5314e3a3
7172024-11-15T21:38:34.809ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_edd0c7a0-e093-44a9-845e-02d5df012651
7182024-11-15T21:38:34.809ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7192024-11-15T21:38:34.809ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7202024-11-15T21:38:34.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8890623 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44978 req_id = f6da397d-c2b6-409a-a9cc-ef4d382bc233 response_code = 204 uri = /omicron-zones
7212024-11-15T21:38:34.812ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7222024-11-15T21:38:35.288ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15394789484286491604 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
7232024-11-15T21:38:35.288ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4893672133155549866 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
7242024-11-15T21:38:35.315ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 98.557118ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7252024-11-15T21:38:35.433ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7262024-11-15T21:38:35.481ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7272024-11-15T21:38:35.529ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7282024-11-15T21:38:35.529ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7292024-11-15T21:38:35.561ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7302024-11-15T21:38:35.562ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7312024-11-15T21:38:35.562ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7322024-11-15T21:38:35.591ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: edd0c7a0-e093-44a9-845e-02d5df012651 (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2 (service), filesystem_pool: Some(ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 457f990d-f83f-40bb-8721-4e2b5314e3a3 (service), filesystem_pool: Some(ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 3a296fdd-a341-4fdc-a08b-357d0f40b12a (service), filesystem_pool: Some(ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2cb0e79b-f8be-40eb-ab18-2f421d58ee7a, kind: Service { id: 3a296fdd-a341-4fdc-a08b-357d0f40b12a }, name: Name("ntp-3a296fdd-a341-4fdc-a08b-357d0f40b12a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 165])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7332024-11-15T21:38:35.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58712
7342024-11-15T21:38:35.591ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edd0c7a0-e093-44a9-845e-02d5df012651, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7352024-11-15T21:38:35.591ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edd0c7a0-e093-44a9-845e-02d5df012651, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7362024-11-15T21:38:35.628ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7372024-11-15T21:38:35.628ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7382024-11-15T21:38:35.661ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 457f990d-f83f-40bb-8721-4e2b5314e3a3, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7392024-11-15T21:38:35.662ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 457f990d-f83f-40bb-8721-4e2b5314e3a3, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7402024-11-15T21:38:35.696ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7412024-11-15T21:38:35.696ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:177
7422024-11-15T21:38:35.696ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:177
7432024-11-15T21:38:35.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7442024-11-15T21:38:35.708ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7452024-11-15T21:38:35.740ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7462024-11-15T21:38:35.741ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7472024-11-15T21:38:35.741ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7482024-11-15T21:38:35.770ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 180, 165]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7492024-11-15T21:38:35.770ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7502024-11-15T21:38:35.770ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7512024-11-15T21:38:35.770ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7522024-11-15T21:38:35.771ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7532024-11-15T21:38:35.772ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7542024-11-15T21:38:35.796ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a file = illumos-utils/src/zone.rs:325
7552024-11-15T21:38:35.815ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a file = illumos-utils/src/zone.rs:363
7562024-11-15T21:38:36.419ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7572024-11-15T21:38:36.419ZINFOSledAgent (ServiceManager): Booting oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a
7582024-11-15T21:38:36.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a") failed: Property not found. retry in 67.5908ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a
7592024-11-15T21:38:36.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a") failed: Property not found. retry in 119.026002ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a
7602024-11-15T21:38:36.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a") failed: Property not found. retry in 125.898345ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a
7612024-11-15T21:38:36.771ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
7622024-11-15T21:38:36.771ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
7632024-11-15T21:38:36.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a") failed: Property not found. retry in 327.998733ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a
7642024-11-15T21:38:37.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a") failed: Property not found. retry in 862.16432ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a
7652024-11-15T21:38:38.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a") failed: Property not found. retry in 1.088017546s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a
7662024-11-15T21:38:39.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a") failed: Property not found. retry in 591.972287ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a
7672024-11-15T21:38:39.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a") failed: Property not found. retry in 1.182939768s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a
7682024-11-15T21:38:40.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a") failed: Property not found. retry in 1.145937582s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a
7692024-11-15T21:38:42.180ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a
7702024-11-15T21:38:42.180ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7712024-11-15T21:38:42.181ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7722024-11-15T21:38:42.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6590221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58712 req_id = e15a8e7f-173f-40a7-b09d-528644b0a849 response_code = 204 uri = /omicron-zones
7732024-11-15T21:38:42.183ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7742024-11-15T21:38:42.212ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7752024-11-15T21:38:42.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49241
7762024-11-15T21:38:42.221ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7772024-11-15T21:38:42.221ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8461 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49241 req_id = f0bf58c7-0128-456d-a2ec-432f82697a09 response_code = 500 uri = /timesync
7782024-11-15T21:38:42.224ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7792024-11-15T21:38:42.345ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7802024-11-15T21:38:42.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59094
7812024-11-15T21:38:44.340ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14726482828025440804 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
7822024-11-15T21:38:44.463ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13053692012090730826 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
7832024-11-15T21:38:44.812ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1653334661125062521 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
7842024-11-15T21:38:45.289ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15394789484286491604 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
7852024-11-15T21:38:45.290ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4893672133155549866 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
7862024-11-15T21:38:46.354ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7872024-11-15T21:38:46.354ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008687 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59094 req_id = 81eae86d-9354-48a8-8bcc-041eb9e39444 response_code = 500 uri = /timesync
7882024-11-15T21:38:46.356ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7892024-11-15T21:38:46.475ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7902024-11-15T21:38:46.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52017
7912024-11-15T21:38:46.483ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7922024-11-15T21:38:46.483ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8085 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52017 req_id = db9ab99a-9146-4fd5-bce9-14e26738e7c2 response_code = 500 uri = /timesync
7932024-11-15T21:38:46.485ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7942024-11-15T21:38:46.622ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7952024-11-15T21:38:46.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48916
7962024-11-15T21:38:46.773ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
7972024-11-15T21:38:46.774ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
7982024-11-15T21:38:51.598ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_3a296fdd-a341-4fdc-a08b-357d0f40b12a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7992024-11-15T21:38:51.598ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48916 req_id = d2c5d3c9-ae29-4272-9695-febbc1be9f8f response_code = 500 uri = /timesync
8002024-11-15T21:38:51.601ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8012024-11-15T21:38:51.881ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8022024-11-15T21:38:51.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55135
8032024-11-15T21:38:51.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8673 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55135 req_id = 9e6c2349-0df5-4e53-89cc-223b7673b559 response_code = 200 uri = /timesync
8042024-11-15T21:38:51.892ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731706729.6532717, correction: -0.382722765 } file = sled-agent/src/rack_setup/service.rs:740
8052024-11-15T21:38:51.892ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8062024-11-15T21:38:52.214ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8072024-11-15T21:38:52.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32784
8082024-11-15T21:38:52.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32784 req_id = 2f0a73c5-f80b-4412-b306-e7d038865d0a response_code = 200 uri = /timesync
8092024-11-15T21:38:52.225ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706731.5634727, correction: -0.397001863 } file = sled-agent/src/rack_setup/service.rs:740
8102024-11-15T21:38:52.225ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8112024-11-15T21:38:52.471ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8122024-11-15T21:38:52.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46776
8132024-11-15T21:38:52.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46776 req_id = fbb5ea2b-23a4-46a9-9270-33e8875f3944 response_code = 200 uri = /timesync
8142024-11-15T21:38:52.483ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731706729.6532717, correction: -0.396302283 } file = sled-agent/src/rack_setup/service.rs:740
8152024-11-15T21:38:52.483ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8162024-11-15T21:38:52.908ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8172024-11-15T21:38:52.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56072
8182024-11-15T21:38:52.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7919 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56072 req_id = de5dbf84-a0df-4820-ad14-c2c80b002ed6 response_code = 200 uri = /timesync
8192024-11-15T21:38:52.920ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731706729.6532717, correction: -0.395117462 } file = sled-agent/src/rack_setup/service.rs:740
8202024-11-15T21:38:52.920ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8212024-11-15T21:38:53.146ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14743978627837366202 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8222024-11-15T21:38:53.147ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4015793786766959759 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8232024-11-15T21:38:53.305ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8242024-11-15T21:38:53.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47850
8252024-11-15T21:38:53.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7857 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47850 req_id = 46ecc410-b653-4591-b359-79e96fc81c9d response_code = 200 uri = /timesync
8262024-11-15T21:38:53.317ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731706729.6532717, correction: -0.379020929 } file = sled-agent/src/rack_setup/service.rs:740
8272024-11-15T21:38:53.317ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8282024-11-15T21:38:53.567ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8292024-11-15T21:38:53.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61005
8302024-11-15T21:38:53.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8400 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61005 req_id = 4650e44e-cc88-46ae-9af4-65810b7e3fe2 response_code = 200 uri = /timesync
8312024-11-15T21:38:53.579ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731706729.6532717, correction: -0.378309846 } file = sled-agent/src/rack_setup/service.rs:740
8322024-11-15T21:38:53.579ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8332024-11-15T21:38:54.108ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8342024-11-15T21:38:54.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62255
8352024-11-15T21:38:54.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8766 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62255 req_id = 38a83aea-9692-4bf9-8389-2337a289b2ea response_code = 200 uri = /timesync
8362024-11-15T21:38:54.119ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731706729.6532717, correction: -0.37683776 } file = sled-agent/src/rack_setup/service.rs:740
8372024-11-15T21:38:54.119ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8382024-11-15T21:38:54.665ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8392024-11-15T21:38:54.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36312
8402024-11-15T21:38:54.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7752 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36312 req_id = 430c29ef-43dd-4ac6-b47a-d7966e4216a2 response_code = 200 uri = /timesync
8412024-11-15T21:38:54.675ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731706729.6532717, correction: -0.375652909 } file = sled-agent/src/rack_setup/service.rs:740
8422024-11-15T21:38:54.675ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8432024-11-15T21:38:55.299ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14726482828025440804 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8442024-11-15T21:38:55.421ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13053692012090730826 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8452024-11-15T21:38:55.670ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8462024-11-15T21:38:55.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34266
8472024-11-15T21:38:55.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8361 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34266 req_id = 0349675c-4a16-43f3-8fbb-23e235993ea8 response_code = 200 uri = /timesync
8482024-11-15T21:38:55.682ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731706729.6532717, correction: -0.371228576 } file = sled-agent/src/rack_setup/service.rs:740
8492024-11-15T21:38:55.682ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8502024-11-15T21:38:55.770ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1653334661125062521 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8512024-11-15T21:38:56.245ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15394789484286491604 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8522024-11-15T21:38:56.246ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4893672133155549866 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8532024-11-15T21:38:56.582ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8542024-11-15T21:38:56.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64175
8552024-11-15T21:38:56.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9445 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64175 req_id = a7047470-df6d-4280-8db3-3d13d79c7da2 response_code = 200 uri = /timesync
8562024-11-15T21:38:56.594ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731706729.6532717, correction: -0.362386853 } file = sled-agent/src/rack_setup/service.rs:740
8572024-11-15T21:38:56.594ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8582024-11-15T21:38:56.898ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56642
8592024-11-15T21:38:56.898ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56642 req_id = 7a9aef24-453b-4391-a1ed-5bdcd9956f38 response_code = 200 uri = /baseboard
8602024-11-15T21:38:57.287ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8612024-11-15T21:38:57.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50964
8622024-11-15T21:38:57.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8835 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50964 req_id = 455ab662-04eb-4cab-98dc-0080cccd617d response_code = 200 uri = /timesync
8632024-11-15T21:38:57.300ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731706729.6532717, correction: -0.356832892 } file = sled-agent/src/rack_setup/service.rs:740
8642024-11-15T21:38:57.300ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8652024-11-15T21:38:57.726ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8662024-11-15T21:38:57.726ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8672024-11-15T21:38:58.133ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 250.33003ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8682024-11-15T21:38:58.926ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8692024-11-15T21:38:58.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52023
8702024-11-15T21:38:58.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52023 req_id = d83a8c4c-28bd-446e-b041-8f53fae44bb5 response_code = 200 uri = /timesync
8712024-11-15T21:38:58.936ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1731706729.6532717, correction: -0.352613181 } file = sled-agent/src/rack_setup/service.rs:740
8722024-11-15T21:38:58.936ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8732024-11-15T21:39:01.152ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8742024-11-15T21:39:01.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53545
8752024-11-15T21:39:01.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8639 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53545 req_id = 293bf882-5e9a-4ecb-b7e8-e98841c7d8b6 response_code = 200 uri = /timesync
8762024-11-15T21:39:01.163ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706739.2689512, correction: -0.346974194 } file = sled-agent/src/rack_setup/service.rs:740
8772024-11-15T21:39:01.163ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8782024-11-15T21:39:03.122ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14743978627837366202 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8792024-11-15T21:39:03.122ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4015793786766959759 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8802024-11-15T21:39:03.786ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8812024-11-15T21:39:03.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59315
8822024-11-15T21:39:03.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8908 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59315 req_id = 370a37c2-4411-4a3e-b801-0387c9dc04fd response_code = 200 uri = /timesync
8832024-11-15T21:39:03.797ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706742.5968077, correction: -0.338723898 } file = sled-agent/src/rack_setup/service.rs:740
8842024-11-15T21:39:03.797ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8852024-11-15T21:39:05.138ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8862024-11-15T21:39:05.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44252
8872024-11-15T21:39:05.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44252 req_id = 96770329-b73c-4603-94af-1f06822f57a2 response_code = 200 uri = /timesync
8882024-11-15T21:39:05.151ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706743.390749, correction: -0.335433602 } file = sled-agent/src/rack_setup/service.rs:740
8892024-11-15T21:39:05.151ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8902024-11-15T21:39:05.274ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14726482828025440804 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8912024-11-15T21:39:05.395ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13053692012090730826 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8922024-11-15T21:39:05.746ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1653334661125062521 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8932024-11-15T21:39:06.220ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15394789484286491604 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8942024-11-15T21:39:06.220ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4893672133155549866 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8952024-11-15T21:39:07.702ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8962024-11-15T21:39:07.702ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
8972024-11-15T21:39:08.464ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8982024-11-15T21:39:08.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41688
8992024-11-15T21:39:08.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8386 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41688 req_id = b4b41185-2deb-473d-b969-7fafa18feeb0 response_code = 200 uri = /timesync
9002024-11-15T21:39:08.474ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706747.7439332, correction: -0.326384485 } file = sled-agent/src/rack_setup/service.rs:740
9012024-11-15T21:39:08.474ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9022024-11-15T21:39:11.170ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9032024-11-15T21:39:11.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42024
9042024-11-15T21:39:11.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8579 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42024 req_id = 63f8dcf0-32bb-4a86-9d8f-71c22a0c7255 response_code = 200 uri = /timesync
9052024-11-15T21:39:11.183ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706749.7376518, correction: -0.319142342 } file = sled-agent/src/rack_setup/service.rs:740
9062024-11-15T21:39:11.183ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9072024-11-15T21:39:13.096ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14743978627837366202 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9082024-11-15T21:39:13.097ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4015793786766959759 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9092024-11-15T21:39:13.376ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 723.197203ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9102024-11-15T21:39:14.102ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9112024-11-15T21:39:14.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56405
9122024-11-15T21:39:14.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8857 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56405 req_id = 450e0065-c83b-4fab-ab99-3a00d8b9a096 response_code = 200 uri = /timesync
9132024-11-15T21:39:14.114ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706751.23206, correction: -0.31069243 } file = sled-agent/src/rack_setup/service.rs:740
9142024-11-15T21:39:14.114ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9152024-11-15T21:39:15.250ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14726482828025440804 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9162024-11-15T21:39:15.369ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13053692012090730826 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9172024-11-15T21:39:15.720ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1653334661125062521 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9182024-11-15T21:39:16.193ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15394789484286491604 reason = Duration(60s) sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9192024-11-15T21:39:16.194ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4893672133155549866 reason = Duration(60s) sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9202024-11-15T21:39:17.634ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9212024-11-15T21:39:17.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39262
9222024-11-15T21:39:17.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9047 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39262 req_id = e068c591-57e3-4d23-ab92-14a22e0fe872 response_code = 200 uri = /timesync
9232024-11-15T21:39:17.645ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706754.500005, correction: -0.301381499 } file = sled-agent/src/rack_setup/service.rs:740
9242024-11-15T21:39:17.645ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9252024-11-15T21:39:17.676ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9262024-11-15T21:39:17.676ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9272024-11-15T21:39:23.071ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14743978627837366202 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9282024-11-15T21:39:23.072ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4015793786766959759 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9292024-11-15T21:39:24.365ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9302024-11-15T21:39:24.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64206
9312024-11-15T21:39:24.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8574 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64206 req_id = 0ddc9f15-fdd4-414e-9ddd-d6d3b86c667a response_code = 200 uri = /timesync
9322024-11-15T21:39:24.378ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706761.5490956, correction: -0.283600807 } file = sled-agent/src/rack_setup/service.rs:740
9332024-11-15T21:39:24.378ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9342024-11-15T21:39:25.226ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14726482828025440804 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9352024-11-15T21:39:25.342ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13053692012090730826 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9362024-11-15T21:39:25.696ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1653334661125062521 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9372024-11-15T21:39:26.850ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38880
9382024-11-15T21:39:26.850ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38880 req_id = fc122ebe-fa3c-46da-b6fb-3b4f94b40af8 response_code = 200 uri = /baseboard
9392024-11-15T21:39:27.652ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9402024-11-15T21:39:27.652ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9412024-11-15T21:39:29.101ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.499821719s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9422024-11-15T21:39:32.868ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9432024-11-15T21:39:32.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50711
9442024-11-15T21:39:32.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8489 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50711 req_id = 3244ded2-ced3-4750-8f90-9e92eaa4bb67 response_code = 200 uri = /timesync
9452024-11-15T21:39:32.879ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706771.5720782, correction: -0.26138705 } file = sled-agent/src/rack_setup/service.rs:740
9462024-11-15T21:39:32.879ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9472024-11-15T21:39:33.047ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14743978627837366202 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9482024-11-15T21:39:33.048ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4015793786766959759 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9492024-11-15T21:39:35.201ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14726482828025440804 reason = Duration(60s) sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9502024-11-15T21:39:35.317ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13053692012090730826 reason = Duration(60s) sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9512024-11-15T21:39:35.670ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1653334661125062521 reason = Duration(60s) sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9522024-11-15T21:39:37.628ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9532024-11-15T21:39:37.628ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9542024-11-15T21:39:39.217ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9552024-11-15T21:39:39.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40760
9562024-11-15T21:39:39.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9045 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40760 req_id = 62817855-269b-45cc-aa9f-dc4b451bbd27 response_code = 200 uri = /timesync
9572024-11-15T21:39:39.229ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706776.32679, correction: -0.244227856 } file = sled-agent/src/rack_setup/service.rs:740
9582024-11-15T21:39:39.229ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9592024-11-15T21:39:43.023ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14743978627837366202 reason = Duration(60s) sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9602024-11-15T21:39:43.023ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 4015793786766959759 reason = Duration(60s) sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9612024-11-15T21:39:44.403ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9622024-11-15T21:39:44.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33708
9632024-11-15T21:39:44.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9477 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33708 req_id = 61bbe8ba-9277-4718-a869-4df502fa2399 response_code = 200 uri = /timesync
9642024-11-15T21:39:44.415ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706776.32679, correction: -0.23014392 } file = sled-agent/src/rack_setup/service.rs:740
9652024-11-15T21:39:44.415ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9662024-11-15T21:39:45.589ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.71012351s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9672024-11-15T21:39:47.602ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9682024-11-15T21:39:47.602ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9692024-11-15T21:39:56.246ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9702024-11-15T21:39:56.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33733
9712024-11-15T21:39:56.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8644 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33733 req_id = 5d57383e-c8c7-442b-88a0-9f3f5ad6824f response_code = 200 uri = /timesync
9722024-11-15T21:39:56.258ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706794.411401, correction: -0.197102398 } file = sled-agent/src/rack_setup/service.rs:740
9732024-11-15T21:39:56.258ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9742024-11-15T21:39:56.804ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54395
9752024-11-15T21:39:56.804ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54395 req_id = c80debb2-54f1-49bd-b3b8-7f835f2b67a7 response_code = 200 uri = /baseboard
9762024-11-15T21:39:57.577ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9772024-11-15T21:39:57.578ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9782024-11-15T21:40:03.286ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.481883589s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9792024-11-15T21:40:04.631ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9802024-11-15T21:40:04.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63028
9812024-11-15T21:40:04.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9010 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63028 req_id = 582b0894-3908-4129-942e-b7c25f3fdc24 response_code = 200 uri = /timesync
9822024-11-15T21:40:04.643ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706800.386991, correction: -0.174659878 } file = sled-agent/src/rack_setup/service.rs:740
9832024-11-15T21:40:04.643ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9842024-11-15T21:40:07.552ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9852024-11-15T21:40:07.553ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9862024-11-15T21:40:17.527ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9872024-11-15T21:40:17.527ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9882024-11-15T21:40:23.747ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.015884892s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9892024-11-15T21:40:26.756ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45644
9902024-11-15T21:40:26.756ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45644 req_id = 4956703c-c99c-4a73-9eb3-6e00713fca6d response_code = 200 uri = /baseboard
9912024-11-15T21:40:27.502ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9922024-11-15T21:40:27.503ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9932024-11-15T21:40:29.269ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9942024-11-15T21:40:29.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50803
9952024-11-15T21:40:29.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9426 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50803 req_id = fff9a749-9507-4c50-92d1-a26a81ad1c5c response_code = 200 uri = /timesync
9962024-11-15T21:40:29.281ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706825.3293376, correction: -0.107374527 } file = sled-agent/src/rack_setup/service.rs:740
9972024-11-15T21:40:29.281ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9982024-11-15T21:40:37.477ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
9992024-11-15T21:40:37.477ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
10002024-11-15T21:40:47.453ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17596721871929712347 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
10012024-11-15T21:40:47.453ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3014747358860649568 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
10022024-11-15T21:40:47.732ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 12.113170397s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
10032024-11-15T21:40:55.600ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10042024-11-15T21:40:55.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40351
10052024-11-15T21:40:55.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40351 req_id = 5a762c78-97e8-4c2e-9d71-729fb75b7fad response_code = 200 uri = /timesync
10062024-11-15T21:40:55.623ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-15T21:39:16.193944122Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15394789484286491604 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
10072024-11-15T21:40:55.624ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-15T21:39:35.201610621Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14726482828025440804 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
10082024-11-15T21:40:55.625ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-15T21:39:35.670431833Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1653334661125062521 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
10092024-11-15T21:40:55.625ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-15T21:39:35.317794416Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13053692012090730826 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
10102024-11-15T21:40:55.626ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-15T21:39:16.194705377Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4893672133155549866 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
10112024-11-15T21:40:55.626ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-15T21:39:43.023083403Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14743978627837366202 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
10122024-11-15T21:40:55.626ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-15T21:39:43.023440995Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 4015793786766959759 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
10132024-11-15T21:40:55.627ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1163513799, ip_addr: 69.89.207.199, stratum: 2, ref_time: 1731706833.2371275, correction: -0.036218051 } file = sled-agent/src/rack_setup/service.rs:740
10142024-11-15T21:40:55.627ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
10152024-11-15T21:40:55.656ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: edd0c7a0-e093-44a9-845e-02d5df012651 (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2 (service), filesystem_pool: Some(ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 457f990d-f83f-40bb-8721-4e2b5314e3a3 (service), filesystem_pool: Some(ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 3a296fdd-a341-4fdc-a08b-357d0f40b12a (service), filesystem_pool: Some(ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2cb0e79b-f8be-40eb-ab18-2f421d58ee7a, kind: Service { id: 3a296fdd-a341-4fdc-a08b-357d0f40b12a }, name: Name("ntp-3a296fdd-a341-4fdc-a08b-357d0f40b12a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 165])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 55e4078f-3297-4527-bf90-04663df031df (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External } } } }, OmicronZoneConfig { id: 657304c3-e825-46bc-b579-9361a07f5100 (service), filesystem_pool: Some(ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 85ea46f1-f23a-49f9-a395-6162f1a20ba9 (service), filesystem_pool: Some(ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2510e264-32a9-44fb-9e3c-2bf735566f48 (service), filesystem_pool: Some(ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External } } } }, OmicronZoneConfig { id: 34e23e46-8f84-4745-82c3-8299c5661cb4 (service), filesystem_pool: Some(ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10162024-11-15T21:40:55.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55175
10172024-11-15T21:40:55.656ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edd0c7a0-e093-44a9-845e-02d5df012651, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10182024-11-15T21:40:55.656ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edd0c7a0-e093-44a9-845e-02d5df012651, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10192024-11-15T21:40:55.692ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10202024-11-15T21:40:55.692ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10212024-11-15T21:40:55.728ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 457f990d-f83f-40bb-8721-4e2b5314e3a3, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10222024-11-15T21:40:55.728ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 457f990d-f83f-40bb-8721-4e2b5314e3a3, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10232024-11-15T21:40:55.760ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 55e4078f-3297-4527-bf90-04663df031df, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10242024-11-15T21:40:55.760ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 55e4078f-3297-4527-bf90-04663df031df, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10252024-11-15T21:40:55.793ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 657304c3-e825-46bc-b579-9361a07f5100, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10262024-11-15T21:40:55.793ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 657304c3-e825-46bc-b579-9361a07f5100, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10272024-11-15T21:40:55.826ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 85ea46f1-f23a-49f9-a395-6162f1a20ba9, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10282024-11-15T21:40:55.826ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 85ea46f1-f23a-49f9-a395-6162f1a20ba9, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10292024-11-15T21:40:55.858ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2510e264-32a9-44fb-9e3c-2bf735566f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10302024-11-15T21:40:55.858ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2510e264-32a9-44fb-9e3c-2bf735566f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10312024-11-15T21:40:55.891ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 34e23e46-8f84-4745-82c3-8299c5661cb4, dataset_name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10322024-11-15T21:40:55.891ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 34e23e46-8f84-4745-82c3-8299c5661cb4, dataset_name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10332024-11-15T21:40:55.923ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10342024-11-15T21:40:55.924ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:177
10352024-11-15T21:40:55.924ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:177
10362024-11-15T21:40:55.924ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10372024-11-15T21:40:56.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10382024-11-15T21:40:56.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10392024-11-15T21:40:56.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10402024-11-15T21:40:56.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10412024-11-15T21:40:56.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10422024-11-15T21:40:56.103ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100 file = illumos-utils/src/zone.rs:325
10432024-11-15T21:40:56.107ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df file = illumos-utils/src/zone.rs:325
10442024-11-15T21:40:56.111ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48 file = illumos-utils/src/zone.rs:325
10452024-11-15T21:40:56.115ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4 file = illumos-utils/src/zone.rs:325
10462024-11-15T21:40:56.119ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9 file = illumos-utils/src/zone.rs:325
10472024-11-15T21:40:56.124ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100 file = illumos-utils/src/zone.rs:363
10482024-11-15T21:40:56.128ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df file = illumos-utils/src/zone.rs:363
10492024-11-15T21:40:56.133ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48 file = illumos-utils/src/zone.rs:363
10502024-11-15T21:40:56.138ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4 file = illumos-utils/src/zone.rs:363
10512024-11-15T21:40:56.142ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9 file = illumos-utils/src/zone.rs:363
10522024-11-15T21:40:56.709ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55382
10532024-11-15T21:40:56.709ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55382 req_id = 3e691496-a085-42c3-adbf-b23a44a00dea response_code = 200 uri = /baseboard
10542024-11-15T21:40:59.026ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='657304c3-e825-46bc-b579-9361a07f5100'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10552024-11-15T21:40:59.026ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
10562024-11-15T21:40:59.034ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='85ea46f1-f23a-49f9-a395-6162f1a20ba9'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10572024-11-15T21:40:59.034ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
10582024-11-15T21:40:59.110ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='55e4078f-3297-4527-bf90-04663df031df'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10592024-11-15T21:40:59.110ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
10602024-11-15T21:40:59.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9") failed: Property not found. retry in 72.734628ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
10612024-11-15T21:40:59.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 28.942575ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
10622024-11-15T21:40:59.176ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2510e264-32a9-44fb-9e3c-2bf735566f48'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10632024-11-15T21:40:59.176ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
10642024-11-15T21:40:59.190ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='34e23e46-8f84-4745-82c3-8299c5661cb4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10652024-11-15T21:40:59.190ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
10662024-11-15T21:40:59.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 75.077572ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
10672024-11-15T21:40:59.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9") failed: Property not found. retry in 107.538071ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
10682024-11-15T21:40:59.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 151.503089ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
10692024-11-15T21:41:00.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 50.367133ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
10702024-11-15T21:41:00.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9") failed: Property not found. retry in 268.102892ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
10712024-11-15T21:41:00.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 456.133382ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
10722024-11-15T21:41:00.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 54.119656ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
10732024-11-15T21:41:00.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48") failed: Property not found. retry in 73.411882ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
10742024-11-15T21:41:00.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 202.015378ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
10752024-11-15T21:41:00.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4") failed: Property not found. retry in 51.045354ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
10762024-11-15T21:41:00.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9") failed: Property not found. retry in 539.768247ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
10772024-11-15T21:41:00.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48") failed: Property not found. retry in 55.268254ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
10782024-11-15T21:41:00.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4") failed: Property not found. retry in 85.665515ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
10792024-11-15T21:41:00.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 714.81811ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
10802024-11-15T21:41:00.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 389.213448ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
10812024-11-15T21:41:00.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48") failed: Property not found. retry in 234.670913ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
10822024-11-15T21:41:01.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4") failed: Property not found. retry in 138.045548ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
10832024-11-15T21:41:01.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4") failed: Property not found. retry in 277.271056ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
10842024-11-15T21:41:01.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48") failed: Property not found. retry in 252.512738ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
10852024-11-15T21:41:01.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9") failed: Property not found. retry in 718.680437ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
10862024-11-15T21:41:01.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 823.266438ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
10872024-11-15T21:41:01.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4") failed: Property not found. retry in 984.913973ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
10882024-11-15T21:41:01.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 999.523871ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
10892024-11-15T21:41:01.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48") failed: Property not found. retry in 639.423193ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
10902024-11-15T21:41:02.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9") failed: Property not found. retry in 667.578368ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
10912024-11-15T21:41:02.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 1.427768428s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
10922024-11-15T21:41:02.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48") failed: Property not found. retry in 978.042062ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
10932024-11-15T21:41:02.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4") failed: Property not found. retry in 985.87412ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
10942024-11-15T21:41:02.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 1.128965064s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
10952024-11-15T21:41:02.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9") failed: Property not found. retry in 1.46394027s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
10962024-11-15T21:41:03.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48") failed: Property not found. retry in 710.304296ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
10972024-11-15T21:41:03.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4") failed: Property not found. retry in 1.10581217s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
10982024-11-15T21:41:03.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 1.201511135s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
10992024-11-15T21:41:03.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 639.827318ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
11002024-11-15T21:41:03.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48") failed: Property not found. retry in 1.493436638s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
11012024-11-15T21:41:04.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9") failed: Property not found. retry in 1.15218673s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
11022024-11-15T21:41:04.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 1.042714933s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
11032024-11-15T21:41:04.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4") failed: Property not found. retry in 1.191887045s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
11042024-11-15T21:41:04.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 1.394145063s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11052024-11-15T21:41:05.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9") failed: Property not found. retry in 538.263107ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
11062024-11-15T21:41:05.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 1.01883773s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
11072024-11-15T21:41:05.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48") failed: Property not found. retry in 637.113712ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
11082024-11-15T21:41:05.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4") failed: Property not found. retry in 1.263397376s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
11092024-11-15T21:41:05.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9") failed: Property not found. retry in 1.014314407s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
11102024-11-15T21:41:06.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48") failed: Property not found. retry in 1.167871594s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
11112024-11-15T21:41:06.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 801.165279ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11122024-11-15T21:41:06.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 753.815853ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
11132024-11-15T21:41:06.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9") failed: Property not found. retry in 1.457471119s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
11142024-11-15T21:41:07.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 580.112372ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11152024-11-15T21:41:07.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4") failed: Property not found. retry in 817.457981ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
11162024-11-15T21:41:07.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100") failed: Property not found. retry in 1.427057509s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
11172024-11-15T21:41:07.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48") failed: Property not found. retry in 1.377611243s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
11182024-11-15T21:41:07.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 1.012078329s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11192024-11-15T21:41:08.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 1.408926158s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11202024-11-15T21:41:10.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 1.025177905s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11212024-11-15T21:41:11.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 540.927136ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11222024-11-15T21:41:11.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 767.030263ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11232024-11-15T21:41:12.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 575.186727ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11242024-11-15T21:41:13.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 1.189240327s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11252024-11-15T21:41:14.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 1.350874537s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11262024-11-15T21:41:14.876ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 25.550293905s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
11272024-11-15T21:41:15.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 1.32338708s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11282024-11-15T21:41:17.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 918.243897ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11292024-11-15T21:41:18.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 1.095684266s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11302024-11-15T21:41:19.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df") failed: Property not found. retry in 1.247875386s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11312024-11-15T21:41:20.581ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_657304c3-e825-46bc-b579-9361a07f5100
11322024-11-15T21:41:20.581ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_55e4078f-3297-4527-bf90-04663df031df
11332024-11-15T21:41:20.582ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_2510e264-32a9-44fb-9e3c-2bf735566f48
11342024-11-15T21:41:20.582ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_34e23e46-8f84-4745-82c3-8299c5661cb4
11352024-11-15T21:41:20.582ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_85ea46f1-f23a-49f9-a395-6162f1a20ba9
11362024-11-15T21:41:20.582ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11372024-11-15T21:41:20.582ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11382024-11-15T21:41:20.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24962857 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55175 req_id = 53064e29-3f29-46e9-be95-c680f3f5ceda response_code = 204 uri = /omicron-zones
11392024-11-15T21:41:20.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56530
11402024-11-15T21:41:20.648ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3743
11412024-11-15T21:41:21.398ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11422024-11-15T21:41:34.753ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11432024-11-15T21:41:34.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14136076 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56530 req_id = 3bff47ef-28dc-4d78-bca7-0b1a3749058b response_code = 204 uri = /cockroachdb
11442024-11-15T21:41:34.754ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33683
11452024-11-15T21:41:34.756ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 609 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33683 req_id = dbe9a781-5d78-406a-8ca8-fad93a7627ab response_code = 200 uri = /baseboard
11462024-11-15T21:41:34.790ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: edd0c7a0-e093-44a9-845e-02d5df012651 (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2 (service), filesystem_pool: Some(ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 457f990d-f83f-40bb-8721-4e2b5314e3a3 (service), filesystem_pool: Some(ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 3a296fdd-a341-4fdc-a08b-357d0f40b12a (service), filesystem_pool: Some(ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2cb0e79b-f8be-40eb-ab18-2f421d58ee7a, kind: Service { id: 3a296fdd-a341-4fdc-a08b-357d0f40b12a }, name: Name("ntp-3a296fdd-a341-4fdc-a08b-357d0f40b12a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 165])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 55e4078f-3297-4527-bf90-04663df031df (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External } } } }, OmicronZoneConfig { id: 657304c3-e825-46bc-b579-9361a07f5100 (service), filesystem_pool: Some(ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 85ea46f1-f23a-49f9-a395-6162f1a20ba9 (service), filesystem_pool: Some(ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2510e264-32a9-44fb-9e3c-2bf735566f48 (service), filesystem_pool: Some(ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External } } } }, OmicronZoneConfig { id: 34e23e46-8f84-4745-82c3-8299c5661cb4 (service), filesystem_pool: Some(ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External } } } }, OmicronZoneConfig { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 5e055384-7079-47b2-95bf-5191a730e1f0 (service), filesystem_pool: Some(ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: aa8ce9ac-5427-43e3-b71a-a158955330df (service), filesystem_pool: Some(ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 5ef543c6-773f-4453-b7c6-1ba24a407ceb (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 94ba37d9-0908-49bf-9275-523638ae5095 (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4d944bfa-6a16-4d5e-8e7e-ce5391f301ea (service), filesystem_pool: Some(ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 8c657caf-7c63-43b2-9856-57cce1c7d867 (service), filesystem_pool: Some(ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: e4339503-4d10-45c8-9546-38d7307ffa2e (service), filesystem_pool: Some(ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: b062ef64-d9cf-4a53-8c51-d7f366eafb77 (service), filesystem_pool: Some(ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External } } } }, OmicronZoneConfig { id: 68c7b7cc-2abf-457c-86ef-34c9e3f29f13 (service), filesystem_pool: Some(ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External } } } }, OmicronZoneConfig { id: ea922465-b1d2-4ae2-b8a8-45e2f520cd4c (service), filesystem_pool: Some(ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External } } } }, OmicronZoneConfig { id: fde33484-47f3-4b98-8d55-f6291a155ff1 (service), filesystem_pool: Some(ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7db095ef-0c07-408e-a294-6f51716fa8a4 (service), filesystem_pool: Some(ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2c97a782-015d-457b-aeff-76499dab0254 (service), filesystem_pool: Some(ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External } } } }, OmicronZoneConfig { id: d83efccf-9cd0-4a3c-973e-84dbe2b4483c (service), filesystem_pool: Some(ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External } } } }, OmicronZoneConfig { id: fc42bd69-5037-4101-8fbb-5445b7048efd (service), filesystem_pool: Some(ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External } } } }, OmicronZoneConfig { id: 3b311d1f-8d53-42e1-9f16-4ab110060a18 (service), filesystem_pool: Some(ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11472024-11-15T21:41:34.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51045
11482024-11-15T21:41:34.792ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edd0c7a0-e093-44a9-845e-02d5df012651, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11492024-11-15T21:41:34.792ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edd0c7a0-e093-44a9-845e-02d5df012651, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11502024-11-15T21:41:34.858ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11512024-11-15T21:41:34.858ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5804ddd8-8ad1-42d2-89d7-fdb66142b4f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11522024-11-15T21:41:34.921ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 457f990d-f83f-40bb-8721-4e2b5314e3a3, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11532024-11-15T21:41:34.921ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 457f990d-f83f-40bb-8721-4e2b5314e3a3, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11542024-11-15T21:41:34.987ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 55e4078f-3297-4527-bf90-04663df031df, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11552024-11-15T21:41:34.987ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 55e4078f-3297-4527-bf90-04663df031df, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11562024-11-15T21:41:35.041ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 657304c3-e825-46bc-b579-9361a07f5100, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11572024-11-15T21:41:35.041ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 657304c3-e825-46bc-b579-9361a07f5100, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11582024-11-15T21:41:35.099ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 85ea46f1-f23a-49f9-a395-6162f1a20ba9, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11592024-11-15T21:41:35.099ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 85ea46f1-f23a-49f9-a395-6162f1a20ba9, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11602024-11-15T21:41:35.150ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2510e264-32a9-44fb-9e3c-2bf735566f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11612024-11-15T21:41:35.150ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2510e264-32a9-44fb-9e3c-2bf735566f48, dataset_name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11622024-11-15T21:41:35.259ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 34e23e46-8f84-4745-82c3-8299c5661cb4, dataset_name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11632024-11-15T21:41:35.259ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 34e23e46-8f84-4745-82c3-8299c5661cb4, dataset_name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11642024-11-15T21:41:35.318ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d27385ac-d3f8-425a-9c62-c86cb4a78778, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11652024-11-15T21:41:35.318ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d27385ac-d3f8-425a-9c62-c86cb4a78778, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11662024-11-15T21:41:35.378ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5e055384-7079-47b2-95bf-5191a730e1f0, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11672024-11-15T21:41:35.378ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5e055384-7079-47b2-95bf-5191a730e1f0, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11682024-11-15T21:41:35.450ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 94ba37d9-0908-49bf-9275-523638ae5095, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
11692024-11-15T21:41:35.450ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 94ba37d9-0908-49bf-9275-523638ae5095, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11702024-11-15T21:41:35.500ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b062ef64-d9cf-4a53-8c51-d7f366eafb77, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11712024-11-15T21:41:35.500ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b062ef64-d9cf-4a53-8c51-d7f366eafb77, dataset_name: DatasetName { pool_name: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, kind: Crucible }, responder: ... }
11722024-11-15T21:41:35.565ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 68c7b7cc-2abf-457c-86ef-34c9e3f29f13, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11732024-11-15T21:41:35.565ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 68c7b7cc-2abf-457c-86ef-34c9e3f29f13, dataset_name: DatasetName { pool_name: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, kind: Crucible }, responder: ... }
11742024-11-15T21:41:35.622ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ea922465-b1d2-4ae2-b8a8-45e2f520cd4c, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11752024-11-15T21:41:35.622ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ea922465-b1d2-4ae2-b8a8-45e2f520cd4c, dataset_name: DatasetName { pool_name: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, kind: Crucible }, responder: ... }
11762024-11-15T21:41:35.689ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fde33484-47f3-4b98-8d55-f6291a155ff1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11772024-11-15T21:41:35.689ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fde33484-47f3-4b98-8d55-f6291a155ff1, dataset_name: DatasetName { pool_name: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, kind: Crucible }, responder: ... }
11782024-11-15T21:41:35.764ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7db095ef-0c07-408e-a294-6f51716fa8a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11792024-11-15T21:41:35.764ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7db095ef-0c07-408e-a294-6f51716fa8a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, kind: Crucible }, responder: ... }
11802024-11-15T21:41:35.811ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2c97a782-015d-457b-aeff-76499dab0254, dataset_name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11812024-11-15T21:41:35.812ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2c97a782-015d-457b-aeff-76499dab0254, dataset_name: DatasetName { pool_name: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, kind: Crucible }, responder: ... }
11822024-11-15T21:41:35.886ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d83efccf-9cd0-4a3c-973e-84dbe2b4483c, dataset_name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11832024-11-15T21:41:35.886ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d83efccf-9cd0-4a3c-973e-84dbe2b4483c, dataset_name: DatasetName { pool_name: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, kind: Crucible }, responder: ... }
11842024-11-15T21:41:35.966ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fc42bd69-5037-4101-8fbb-5445b7048efd, dataset_name: DatasetName { pool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11852024-11-15T21:41:35.966ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fc42bd69-5037-4101-8fbb-5445b7048efd, dataset_name: DatasetName { pool_name: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, kind: Crucible }, responder: ... }
11862024-11-15T21:41:36.038ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3b311d1f-8d53-42e1-9f16-4ab110060a18, dataset_name: DatasetName { pool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
11872024-11-15T21:41:36.038ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3b311d1f-8d53-42e1-9f16-4ab110060a18, dataset_name: DatasetName { pool_name: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, kind: Crucible }, responder: ... }
11882024-11-15T21:41:36.102ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11892024-11-15T21:41:36.102ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:177
11902024-11-15T21:41:36.103ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:177
11912024-11-15T21:41:36.103ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11922024-11-15T21:41:36.240ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11932024-11-15T21:41:36.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11942024-11-15T21:41:36.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11952024-11-15T21:41:36.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11962024-11-15T21:41:36.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11972024-11-15T21:41:36.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11982024-11-15T21:41:36.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11992024-11-15T21:41:36.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12002024-11-15T21:41:36.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12012024-11-15T21:41:36.327ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12022024-11-15T21:41:36.508ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12032024-11-15T21:41:36.510ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12042024-11-15T21:41:36.523ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12052024-11-15T21:41:36.523ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12062024-11-15T21:41:36.525ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12072024-11-15T21:41:36.562ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12082024-11-15T21:41:36.562ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12092024-11-15T21:41:36.562ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12102024-11-15T21:41:36.562ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12112024-11-15T21:41:36.562ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c file = illumos-utils/src/zone.rs:325
12122024-11-15T21:41:36.567ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e file = illumos-utils/src/zone.rs:325
12132024-11-15T21:41:36.572ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1 file = illumos-utils/src/zone.rs:325
12142024-11-15T21:41:36.577ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254 file = illumos-utils/src/zone.rs:325
12152024-11-15T21:41:36.582ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd file = illumos-utils/src/zone.rs:325
12162024-11-15T21:41:36.588ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18 file = illumos-utils/src/zone.rs:325
12172024-11-15T21:41:36.593ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095 file = illumos-utils/src/zone.rs:325
12182024-11-15T21:41:36.598ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c file = illumos-utils/src/zone.rs:325
12192024-11-15T21:41:36.603ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867 file = illumos-utils/src/zone.rs:325
12202024-11-15T21:41:36.702ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c file = illumos-utils/src/zone.rs:363
12212024-11-15T21:41:36.706ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e file = illumos-utils/src/zone.rs:363
12222024-11-15T21:41:36.710ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1 file = illumos-utils/src/zone.rs:363
12232024-11-15T21:41:36.714ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254 file = illumos-utils/src/zone.rs:363
12242024-11-15T21:41:36.719ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd file = illumos-utils/src/zone.rs:363
12252024-11-15T21:41:36.724ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18 file = illumos-utils/src/zone.rs:363
12262024-11-15T21:41:36.728ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095 file = illumos-utils/src/zone.rs:363
12272024-11-15T21:41:36.733ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c file = illumos-utils/src/zone.rs:363
12282024-11-15T21:41:36.738ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867 file = illumos-utils/src/zone.rs:363
12292024-11-15T21:41:36.744ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea file = illumos-utils/src/zone.rs:325
12302024-11-15T21:41:36.749ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77 file = illumos-utils/src/zone.rs:325
12312024-11-15T21:41:36.755ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4 file = illumos-utils/src/zone.rs:325
12322024-11-15T21:41:36.761ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13 file = illumos-utils/src/zone.rs:325
12332024-11-15T21:41:36.766ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb file = illumos-utils/src/zone.rs:325
12342024-11-15T21:41:36.774ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea file = illumos-utils/src/zone.rs:363
12352024-11-15T21:41:36.781ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77 file = illumos-utils/src/zone.rs:363
12362024-11-15T21:41:36.789ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4 file = illumos-utils/src/zone.rs:363
12372024-11-15T21:41:36.794ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13 file = illumos-utils/src/zone.rs:363
12382024-11-15T21:41:36.801ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb file = illumos-utils/src/zone.rs:363
12392024-11-15T21:41:36.869ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12402024-11-15T21:41:36.945ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12412024-11-15T21:41:37.043ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12422024-11-15T21:41:37.165ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12432024-11-15T21:41:37.229ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12442024-11-15T21:41:37.231ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12452024-11-15T21:41:37.231ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12462024-11-15T21:41:37.288ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 165, 59]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12472024-11-15T21:41:37.288ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12482024-11-15T21:41:37.291ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12492024-11-15T21:41:37.291ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12502024-11-15T21:41:37.349ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 199, 191]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12512024-11-15T21:41:37.349ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12522024-11-15T21:41:37.351ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12532024-11-15T21:41:37.351ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12542024-11-15T21:41:37.407ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 219, 63]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12552024-11-15T21:41:37.407ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12562024-11-15T21:41:37.409ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12572024-11-15T21:41:37.409ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12582024-11-15T21:41:37.467ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 217, 111]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12592024-11-15T21:41:37.467ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12602024-11-15T21:41:37.469ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12612024-11-15T21:41:37.469ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12622024-11-15T21:41:37.524ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 222, 136]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12632024-11-15T21:41:37.524ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12642024-11-15T21:41:37.525ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12652024-11-15T21:41:37.525ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12662024-11-15T21:41:37.526ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12672024-11-15T21:41:37.526ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12682024-11-15T21:41:37.527ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12692024-11-15T21:41:37.527ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12702024-11-15T21:41:37.527ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12712024-11-15T21:41:37.527ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12722024-11-15T21:41:37.527ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12732024-11-15T21:41:37.527ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12742024-11-15T21:41:37.533ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12752024-11-15T21:41:37.535ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12762024-11-15T21:41:37.537ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12772024-11-15T21:41:37.537ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12782024-11-15T21:41:37.537ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12792024-11-15T21:41:37.540ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12802024-11-15T21:41:37.543ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12812024-11-15T21:41:37.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12822024-11-15T21:41:37.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12832024-11-15T21:41:37.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12842024-11-15T21:41:37.784ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0 file = illumos-utils/src/zone.rs:325
12852024-11-15T21:41:37.790ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e file = illumos-utils/src/zone.rs:325
12862024-11-15T21:41:37.797ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f file = illumos-utils/src/zone.rs:325
12872024-11-15T21:41:37.804ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778 file = illumos-utils/src/zone.rs:325
12882024-11-15T21:41:37.811ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df file = illumos-utils/src/zone.rs:325
12892024-11-15T21:41:37.817ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0 file = illumos-utils/src/zone.rs:363
12902024-11-15T21:41:37.822ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e file = illumos-utils/src/zone.rs:363
12912024-11-15T21:41:37.829ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f file = illumos-utils/src/zone.rs:363
12922024-11-15T21:41:37.836ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778 file = illumos-utils/src/zone.rs:363
12932024-11-15T21:41:37.843ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df file = illumos-utils/src/zone.rs:363
12942024-11-15T21:41:39.995ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12952024-11-15T21:41:39.996ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
12962024-11-15T21:41:40.083ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_07f78be9-2bf1-4fec-908e-2af18da98913/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d29ad1a7-c622-4b77-b9b4-0f9c588766f9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12972024-11-15T21:41:40.083ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12982024-11-15T21:41:40.083ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
12992024-11-15T21:41:40.091ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
13002024-11-15T21:41:40.097ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8601efa0-7d56-406c-bb55-59ecc862a206/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='690d35a3-e4b6-4518-abc6-27bae9781356'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13012024-11-15T21:41:40.097ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='75a3067a-8513-409a-9350-839c17134e0e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13022024-11-15T21:41:40.097ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
13032024-11-15T21:41:40.102ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
13042024-11-15T21:41:40.123ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_75d1b97e-8e16-4b27-ad0e-659366660685/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d950037d-857e-45a2-b0a7-3e72f744f3f8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13052024-11-15T21:41:40.123ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
13062024-11-15T21:41:40.130ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='31cf57df-664f-4aef-86e7-395c61ffc2e8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13072024-11-15T21:41:40.131ZINFOSledAgent (ServiceManager): Booting oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
13082024-11-15T21:41:40.173ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='25bf3e44-1471-454b-b849-5e5b74d26061'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13092024-11-15T21:41:40.174ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
13102024-11-15T21:41:40.181ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_85716c71-25b7-416c-85b5-8758a81c43ee/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e6761ef1-0d9b-4242-9768-e1375e55161b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13112024-11-15T21:41:40.182ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
13122024-11-15T21:41:40.425ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13132024-11-15T21:41:40.425ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
13142024-11-15T21:41:40.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 25.09112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
13152024-11-15T21:41:40.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 61.85787ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
13162024-11-15T21:41:40.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 46.611063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
13172024-11-15T21:41:40.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 38.886587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
13182024-11-15T21:41:40.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 73.162452ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
13192024-11-15T21:41:40.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 39.30137ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
13202024-11-15T21:41:40.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 59.47458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
13212024-11-15T21:41:40.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 56.792018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
13222024-11-15T21:41:40.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 65.326644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
13232024-11-15T21:41:40.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 137.518497ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
13242024-11-15T21:41:40.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 78.687267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
13252024-11-15T21:41:41.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 145.563791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
13262024-11-15T21:41:44.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 89.733937ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
13272024-11-15T21:41:45.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 64.705871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
13282024-11-15T21:41:45.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 47.286721ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
13292024-11-15T21:41:45.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 154.5415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
13302024-11-15T21:41:45.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 161.179762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
13312024-11-15T21:41:45.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 68.83604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
13322024-11-15T21:41:45.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 61.333388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
13332024-11-15T21:41:45.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 162.232747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
13342024-11-15T21:41:45.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 254.351205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
13352024-11-15T21:41:45.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 91.545434ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
13362024-11-15T21:41:45.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 56.677407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
13372024-11-15T21:41:45.902ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13382024-11-15T21:41:45.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 130.161955ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
13392024-11-15T21:41:45.922ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3554a27f-cc97-4d5f-b65f-742b39508465/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='abe98941-a340-4380-a307-bfc687549207'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13402024-11-15T21:41:45.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 299.754567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
13412024-11-15T21:41:45.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 570.457569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
13422024-11-15T21:41:45.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 397.903498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
13432024-11-15T21:41:45.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 167.923699ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
13442024-11-15T21:41:46.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 125.660065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
13452024-11-15T21:41:46.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 173.122086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
13462024-11-15T21:41:46.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 102.072412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
13472024-11-15T21:41:46.037ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
13482024-11-15T21:41:46.047ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
13492024-11-15T21:41:46.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 268.028736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
13502024-11-15T21:41:46.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 193.839871ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
13512024-11-15T21:41:46.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 301.575523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
13522024-11-15T21:41:46.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 369.680604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
13532024-11-15T21:41:46.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 354.016112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
13542024-11-15T21:41:46.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 502.557283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
13552024-11-15T21:41:46.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 314.817467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
13562024-11-15T21:41:46.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 354.338556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
13572024-11-15T21:41:46.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 731.33001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
13582024-11-15T21:41:46.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 558.255543ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
13592024-11-15T21:41:46.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 559.389684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
13602024-11-15T21:41:46.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 1.073625346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
13612024-11-15T21:41:46.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 48.674055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
13622024-11-15T21:41:46.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 879.565308ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
13632024-11-15T21:41:46.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 58.671956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
13642024-11-15T21:41:46.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 95.745991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
13652024-11-15T21:41:46.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 560.112959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
13662024-11-15T21:41:46.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 552.490695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
13672024-11-15T21:41:46.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 907.057418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
13682024-11-15T21:41:46.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 73.762186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
13692024-11-15T21:41:46.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 646.660341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
13702024-11-15T21:41:46.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 211.776507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
13712024-11-15T21:41:46.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 160.860954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
13722024-11-15T21:41:46.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 661.643204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
13732024-11-15T21:41:46.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 569.427796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
13742024-11-15T21:41:46.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 510.600901ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
13752024-11-15T21:41:46.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 1.056550624s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
13762024-11-15T21:41:46.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 565.917871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
13772024-11-15T21:41:47.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 714.209546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
13782024-11-15T21:41:47.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 1.312258154s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
13792024-11-15T21:41:47.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 553.094577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
13802024-11-15T21:41:47.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 690.44367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
13812024-11-15T21:41:47.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 771.260838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
13822024-11-15T21:41:47.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.174607362s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
13832024-11-15T21:41:47.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 730.689903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
13842024-11-15T21:41:47.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 1.013780178s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
13852024-11-15T21:41:47.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 769.589007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
13862024-11-15T21:41:47.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 1.097376666s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
13872024-11-15T21:41:47.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 770.554066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
13882024-11-15T21:41:47.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 614.504026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
13892024-11-15T21:41:47.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 1.060739375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
13902024-11-15T21:41:48.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 614.578025ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
13912024-11-15T21:41:48.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 643.76678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
13922024-11-15T21:41:48.316ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13932024-11-15T21:41:48.316ZINFOSledAgent (ServiceManager): Booting oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
13942024-11-15T21:41:48.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 1.23582492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
13952024-11-15T21:41:48.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 744.018966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
13962024-11-15T21:41:48.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 750.963749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
13972024-11-15T21:41:48.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 710.40507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
13982024-11-15T21:41:48.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 31.810361ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
13992024-11-15T21:41:48.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 581.802961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
14002024-11-15T21:41:48.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 56.183506ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
14012024-11-15T21:41:48.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 1.395279673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
14022024-11-15T21:41:48.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 1.483176731s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
14032024-11-15T21:41:48.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 130.257448ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
14042024-11-15T21:41:48.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 1.034889386s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
14052024-11-15T21:41:48.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 609.603301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
14062024-11-15T21:41:48.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 394.080077ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
14072024-11-15T21:41:48.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 703.469202ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
14082024-11-15T21:41:48.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 1.428877323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
14092024-11-15T21:41:48.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 1.015686322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
14102024-11-15T21:41:49.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 1.414646486s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
14112024-11-15T21:41:49.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 521.024549ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
14122024-11-15T21:41:49.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 1.241576355s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
14132024-11-15T21:41:49.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 927.812739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
14142024-11-15T21:41:49.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 1.057367979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
14152024-11-15T21:41:49.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 1.418198244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
14162024-11-15T21:41:49.523ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f220cd5a-e54e-4a91-a219-9dbe04f196d3'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14172024-11-15T21:41:49.523ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
14182024-11-15T21:41:49.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 806.654469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
14192024-11-15T21:41:49.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 1.289372316s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
14202024-11-15T21:41:49.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 975.694732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
14212024-11-15T21:41:49.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 945.209364ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
14222024-11-15T21:41:49.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 52.64843ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
14232024-11-15T21:41:49.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 81.542533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
14242024-11-15T21:41:50.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 116.14911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
14252024-11-15T21:41:50.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 1.29262584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
14262024-11-15T21:41:50.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 996.211387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
14272024-11-15T21:41:50.093ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='5ef543c6-773f-4453-b7c6-1ba24a407ceb'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14282024-11-15T21:41:50.094ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
14292024-11-15T21:41:50.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 665.823533ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
14302024-11-15T21:41:50.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 253.974569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
14312024-11-15T21:41:50.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 628.714146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
14322024-11-15T21:41:50.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 58.483983ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
14332024-11-15T21:41:50.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 907.332805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
14342024-11-15T21:41:50.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 567.564734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
14352024-11-15T21:41:50.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 65.183878ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
14362024-11-15T21:41:50.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 1.182659521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
14372024-11-15T21:41:50.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.485442192s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
14382024-11-15T21:41:50.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 235.094734ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
14392024-11-15T21:41:50.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 861.588384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
14402024-11-15T21:41:50.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 940.684917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
14412024-11-15T21:41:50.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 533.498669ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
14422024-11-15T21:41:50.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 664.013475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
14432024-11-15T21:41:50.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 1.286946458s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
14442024-11-15T21:41:50.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 706.759406ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
14452024-11-15T21:41:50.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 571.277546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
14462024-11-15T21:41:50.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 1.279903955s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
14472024-11-15T21:41:50.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 984.800989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
14482024-11-15T21:41:51.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 1.333519161s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
14492024-11-15T21:41:51.052ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14502024-11-15T21:41:51.052ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
14512024-11-15T21:41:51.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 985.351421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
14522024-11-15T21:41:51.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 959.671392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
14532024-11-15T21:41:51.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 648.669496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
14542024-11-15T21:41:51.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 30.190291ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
14552024-11-15T21:41:51.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 637.040642ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
14562024-11-15T21:41:51.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 1.170401952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
14572024-11-15T21:41:51.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 92.517551ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
14582024-11-15T21:41:51.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 1.437225945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
14592024-11-15T21:41:51.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 1.383189814s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
14602024-11-15T21:41:51.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 245.098402ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
14612024-11-15T21:41:51.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 1.212596909s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
14622024-11-15T21:41:51.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 750.308259ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
14632024-11-15T21:41:51.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 742.835146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
14642024-11-15T21:41:51.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 262.276322ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
14652024-11-15T21:41:51.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.348027191s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
14662024-11-15T21:41:51.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 1.495997012s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
14672024-11-15T21:41:52.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 673.490872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
14682024-11-15T21:41:52.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 1.343823152s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
14692024-11-15T21:41:52.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 599.180103ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
14702024-11-15T21:41:52.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 780.147714ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
14712024-11-15T21:41:52.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 830.400447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
14722024-11-15T21:41:52.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 1.074600065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
14732024-11-15T21:41:52.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 1.244821887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
14742024-11-15T21:41:52.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 1.427359825s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
14752024-11-15T21:41:52.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 688.452429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
14762024-11-15T21:41:52.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 1.263079765s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
14772024-11-15T21:41:52.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 1.014789139s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
14782024-11-15T21:41:52.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 867.068032ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
14792024-11-15T21:41:52.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 1.112987346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
14802024-11-15T21:41:52.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 502.642331ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
14812024-11-15T21:41:52.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 774.372908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
14822024-11-15T21:41:52.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 502.521636ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
14832024-11-15T21:41:52.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 1.023711504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
14842024-11-15T21:41:52.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 1.020333294s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
14852024-11-15T21:41:53.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 1.45301766s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
14862024-11-15T21:41:53.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 934.847748ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
14872024-11-15T21:41:53.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 1.152111474s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
14882024-11-15T21:41:53.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.09169648s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
14892024-11-15T21:41:53.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 1.095894918s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
14902024-11-15T21:41:53.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 1.022920828s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
14912024-11-15T21:41:53.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 1.178751347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
14922024-11-15T21:41:53.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 1.343807898s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
14932024-11-15T21:41:53.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 1.489011724s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
14942024-11-15T21:41:53.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 729.913612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
14952024-11-15T21:41:53.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 961.015219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
14962024-11-15T21:41:53.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 766.459719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
14972024-11-15T21:41:53.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 1.344173613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
14982024-11-15T21:41:53.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 1.162897966s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
14992024-11-15T21:41:53.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 1.1193439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
15002024-11-15T21:41:53.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 1.068122957s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
15012024-11-15T21:41:54.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 812.124201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
15022024-11-15T21:41:54.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 577.761287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
15032024-11-15T21:41:54.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.008157101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
15042024-11-15T21:41:54.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 745.441293ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
15052024-11-15T21:41:54.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 1.433382504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
15062024-11-15T21:41:54.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 758.679228ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
15072024-11-15T21:41:54.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 1.068173902s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
15082024-11-15T21:41:54.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 869.131147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
15092024-11-15T21:41:54.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 1.455505162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
15102024-11-15T21:41:54.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 906.538414ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
15112024-11-15T21:41:54.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 1.465358083s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
15122024-11-15T21:41:54.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 921.58629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
15132024-11-15T21:41:55.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 530.397258ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
15142024-11-15T21:41:55.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 1.326995378s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
15152024-11-15T21:41:55.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 1.372645349s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
15162024-11-15T21:41:55.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 1.108183964s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
15172024-11-15T21:41:55.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 1.497675178s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
15182024-11-15T21:41:55.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 1.281477581s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
15192024-11-15T21:41:55.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 849.897684ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
15202024-11-15T21:41:55.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 1.222085009s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
15212024-11-15T21:41:55.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 753.897879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
15222024-11-15T21:41:55.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.348072485s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
15232024-11-15T21:41:55.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 782.879746ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
15242024-11-15T21:41:55.666ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 50.986834184s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
15252024-11-15T21:41:55.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 869.354055ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
15262024-11-15T21:41:55.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 1.106634811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
15272024-11-15T21:41:55.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 1.478316642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
15282024-11-15T21:41:55.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 1.077478829s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
15292024-11-15T21:41:56.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 599.629826ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
15302024-11-15T21:41:56.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 1.244649042s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
15312024-11-15T21:41:56.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 967.326918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
15322024-11-15T21:41:56.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 769.629418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
15332024-11-15T21:41:56.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 606.736985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
15342024-11-15T21:41:56.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 1.157477671s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
15352024-11-15T21:41:56.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 1.030623929s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
15362024-11-15T21:41:56.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 1.061423492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
15372024-11-15T21:41:56.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 585.360922ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
15382024-11-15T21:41:56.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 1.004488014s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
15392024-11-15T21:41:56.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 1.391090317s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
15402024-11-15T21:41:56.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 1.173673839s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
15412024-11-15T21:41:56.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 740.69332ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
15422024-11-15T21:41:56.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 577.31495ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
15432024-11-15T21:41:56.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.007717752s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
15442024-11-15T21:41:56.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 684.514128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
15452024-11-15T21:41:56.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 1.155875626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
15462024-11-15T21:41:56.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 1.280994533s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
15472024-11-15T21:41:57.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 1.137150637s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
15482024-11-15T21:41:57.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 684.525151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
15492024-11-15T21:41:57.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 1.125108232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
15502024-11-15T21:41:57.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 1.398189588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
15512024-11-15T21:41:57.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 1.199047619s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
15522024-11-15T21:41:57.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 598.074735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
15532024-11-15T21:41:57.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 1.143458695s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
15542024-11-15T21:41:57.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 623.690286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
15552024-11-15T21:41:57.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 1.387079198s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
15562024-11-15T21:41:57.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 707.571506ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
15572024-11-15T21:41:57.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 742.135178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
15582024-11-15T21:41:57.675ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15592024-11-15T21:41:57.675ZINFOSledAgent (ServiceManager): Booting oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
15602024-11-15T21:41:57.690ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15612024-11-15T21:41:57.690ZINFOSledAgent (ServiceManager): Booting oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
15622024-11-15T21:41:57.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 1.03674143s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
15632024-11-15T21:41:57.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 1.11080015s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
15642024-11-15T21:41:57.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 70.947575ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
15652024-11-15T21:41:57.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 51.705445ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
15662024-11-15T21:41:57.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 92.332619ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
15672024-11-15T21:41:57.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 68.57553ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
15682024-11-15T21:41:57.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 1.060224079s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
15692024-11-15T21:41:57.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.065106063s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
15702024-11-15T21:41:58.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 649.646304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
15712024-11-15T21:41:58.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 140.971917ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
15722024-11-15T21:41:58.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 126.325554ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
15732024-11-15T21:41:58.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 908.681842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
15742024-11-15T21:41:58.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 1.02231367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
15752024-11-15T21:41:58.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 479.096402ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
15762024-11-15T21:41:58.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 1.007073003s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
15772024-11-15T21:41:58.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 488.232265ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
15782024-11-15T21:41:58.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 871.368703ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
15792024-11-15T21:41:58.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 662.403542ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
15802024-11-15T21:41:58.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 1.343496402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
15812024-11-15T21:41:58.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 1.251694199s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
15822024-11-15T21:41:58.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 1.059422981s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
15832024-11-15T21:41:58.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 1.013118041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
15842024-11-15T21:41:58.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 570.007636ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
15852024-11-15T21:41:58.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 1.16848958s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
15862024-11-15T21:41:58.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 507.16627ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
15872024-11-15T21:41:58.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 1.40293808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
15882024-11-15T21:41:58.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 721.722441ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
15892024-11-15T21:41:58.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 660.76966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
15902024-11-15T21:41:58.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 903.867029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
15912024-11-15T21:41:58.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 1.155675072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
15922024-11-15T21:41:59.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 784.659181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
15932024-11-15T21:41:59.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 1.35671983s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
15942024-11-15T21:41:59.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.36534799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
15952024-11-15T21:41:59.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 687.907676ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
15962024-11-15T21:41:59.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 815.749374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
15972024-11-15T21:41:59.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 1.151741414s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
15982024-11-15T21:41:59.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 892.064585ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
15992024-11-15T21:41:59.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 824.390422ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
16002024-11-15T21:41:59.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 1.284324754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
16012024-11-15T21:41:59.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 862.420576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
16022024-11-15T21:41:59.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 727.754043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
16032024-11-15T21:41:59.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 1.355563275s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
16042024-11-15T21:41:59.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 1.069064041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
16052024-11-15T21:41:59.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 1.349272994s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
16062024-11-15T21:41:59.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 577.728225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
16072024-11-15T21:41:59.814ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16082024-11-15T21:41:59.815ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
16092024-11-15T21:41:59.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 836.84145ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
16102024-11-15T21:41:59.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 667.086711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
16112024-11-15T21:41:59.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 1.344380515s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
16122024-11-15T21:41:59.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 584.522326ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
16132024-11-15T21:42:00.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 54.618056ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
16142024-11-15T21:42:00.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 149.584793ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
16152024-11-15T21:42:00.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 922.732501ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
16162024-11-15T21:42:00.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 696.142106ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
16172024-11-15T21:42:00.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 706.967477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
16182024-11-15T21:42:00.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 1.317361614s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
16192024-11-15T21:42:00.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 195.993526ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
16202024-11-15T21:42:00.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 1.429164188s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
16212024-11-15T21:42:00.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 1.190917956s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
16222024-11-15T21:42:00.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 515.109356ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
16232024-11-15T21:42:00.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 979.68187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
16242024-11-15T21:42:00.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.283622713s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
16252024-11-15T21:42:00.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 547.443426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
16262024-11-15T21:42:00.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 338.930383ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
16272024-11-15T21:42:00.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 632.817471ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
16282024-11-15T21:42:00.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 680.246461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
16292024-11-15T21:42:00.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 752.394115ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
16302024-11-15T21:42:00.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 544.169286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
16312024-11-15T21:42:00.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 782.493954ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
16322024-11-15T21:42:00.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 986.942791ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
16332024-11-15T21:42:00.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 1.307983137s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
16342024-11-15T21:42:00.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 971.739277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
16352024-11-15T21:42:00.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 1.320988998s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
16362024-11-15T21:42:00.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 1.340711538s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
16372024-11-15T21:42:01.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 1.11969512s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
16382024-11-15T21:42:01.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 677.104639ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
16392024-11-15T21:42:01.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 1.253588257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
16402024-11-15T21:42:01.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 751.372306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
16412024-11-15T21:42:01.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 881.096756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
16422024-11-15T21:42:01.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 1.327463021s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
16432024-11-15T21:42:01.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 751.902198ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
16442024-11-15T21:42:01.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 939.773304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
16452024-11-15T21:42:01.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 856.2136ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
16462024-11-15T21:42:01.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 893.21337ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
16472024-11-15T21:42:01.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 646.855185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
16482024-11-15T21:42:01.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 1.092853692s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
16492024-11-15T21:42:01.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 765.644396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
16502024-11-15T21:42:01.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 969.274726ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
16512024-11-15T21:42:01.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 621.052297ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
16522024-11-15T21:42:01.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 766.362843ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
16532024-11-15T21:42:01.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 1.331536295s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
16542024-11-15T21:42:01.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 998.005265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
16552024-11-15T21:42:02.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 1.120022982s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
16562024-11-15T21:42:02.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 1.375449731s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
16572024-11-15T21:42:02.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 1.294808253s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
16582024-11-15T21:42:02.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 902.240502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
16592024-11-15T21:42:02.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 1.287959278s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
16602024-11-15T21:42:02.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 1.256742897s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
16612024-11-15T21:42:02.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 595.804628ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
16622024-11-15T21:42:02.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 1.382266472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
16632024-11-15T21:42:02.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 823.102272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
16642024-11-15T21:42:02.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 1.130107976s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
16652024-11-15T21:42:02.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 783.660056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
16662024-11-15T21:42:02.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 833.217846ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
16672024-11-15T21:42:02.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 943.494176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
16682024-11-15T21:42:02.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 1.47886791s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
16692024-11-15T21:42:02.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 876.75165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
16702024-11-15T21:42:02.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 1.15240281s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
16712024-11-15T21:42:02.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 1.075570962s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
16722024-11-15T21:42:02.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 1.104852771s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
16732024-11-15T21:42:02.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 1.30890206s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
16742024-11-15T21:42:03.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 729.302039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
16752024-11-15T21:42:03.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 1.137494581s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
16762024-11-15T21:42:03.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 1.169099181s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
16772024-11-15T21:42:03.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 792.137655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
16782024-11-15T21:42:03.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 1.063460424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
16792024-11-15T21:42:03.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 697.668604ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
16802024-11-15T21:42:03.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 901.658489ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
16812024-11-15T21:42:03.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.277954406s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
16822024-11-15T21:42:03.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 741.866863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
16832024-11-15T21:42:03.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 977.12643ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
16842024-11-15T21:42:03.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 658.274805ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
16852024-11-15T21:42:03.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 758.46723ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
16862024-11-15T21:42:03.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 1.260173616s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
16872024-11-15T21:42:03.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 619.555296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
16882024-11-15T21:42:03.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 987.759736ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
16892024-11-15T21:42:03.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 815.659215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
16902024-11-15T21:42:03.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 795.394967ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
16912024-11-15T21:42:03.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 525.193859ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
16922024-11-15T21:42:04.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 736.816471ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
16932024-11-15T21:42:04.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 585.388293ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
16942024-11-15T21:42:04.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 1.152681999s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
16952024-11-15T21:42:04.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 818.17641ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
16962024-11-15T21:42:04.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 565.283584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
16972024-11-15T21:42:04.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 1.296944054s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
16982024-11-15T21:42:04.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 818.058388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
16992024-11-15T21:42:04.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 908.2358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
17002024-11-15T21:42:04.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 1.068313546s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
17012024-11-15T21:42:04.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 599.235959ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
17022024-11-15T21:42:04.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd") failed: Property not found. retry in 567.3647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
17032024-11-15T21:42:04.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 1.316127609s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
17042024-11-15T21:42:04.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 908.901913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
17052024-11-15T21:42:04.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 684.539682ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
17062024-11-15T21:42:04.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 918.659922ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
17072024-11-15T21:42:04.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 836.758224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
17082024-11-15T21:42:04.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 808.940021ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
17092024-11-15T21:42:04.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 710.399816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
17102024-11-15T21:42:04.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18") failed: Property not found. retry in 1.113734906s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
17112024-11-15T21:42:04.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 615.33853ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
17122024-11-15T21:42:04.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867") failed: Property not found. retry in 1.210025405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
17132024-11-15T21:42:04.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 1.22841996s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
17142024-11-15T21:42:04.873ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56803
17152024-11-15T21:42:04.884ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 476 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56803 req_id = c79b16f3-2f10-480b-a8ac-7b8601fd2d7e response_code = 200 uri = /baseboard
17162024-11-15T21:42:04.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 1.437434835s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
17172024-11-15T21:42:05.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 667.483214ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
17182024-11-15T21:42:05.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 1.454057324s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
17192024-11-15T21:42:05.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0") failed: Property not found. retry in 1.232458213s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
17202024-11-15T21:42:05.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1") failed: Property not found. retry in 1.143811767s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
17212024-11-15T21:42:05.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 1.219836921s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
17222024-11-15T21:42:05.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4") failed: Property not found. retry in 819.498359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
17232024-11-15T21:42:05.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c") failed: Property not found. retry in 659.6149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
17242024-11-15T21:42:05.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 1.181196929s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
17252024-11-15T21:42:05.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e") failed: Property not found. retry in 1.278259626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
17262024-11-15T21:42:05.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 1.025012452s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
17272024-11-15T21:42:05.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254") failed: Property not found. retry in 712.769609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
17282024-11-15T21:42:05.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 629.382498ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
17292024-11-15T21:42:05.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c") failed: Property not found. retry in 1.424393448s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
17302024-11-15T21:42:05.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 938.479173ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
17312024-11-15T21:42:05.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13") failed: Property not found. retry in 1.397710276s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
17322024-11-15T21:42:06.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 1.258228214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
17332024-11-15T21:42:06.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 509.324765ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
17342024-11-15T21:42:06.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 792.690835ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
17352024-11-15T21:42:06.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 504.417158ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
17362024-11-15T21:42:06.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 1.324498792s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
17372024-11-15T21:42:06.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 1.002053264s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
17382024-11-15T21:42:06.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 1.312463118s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
17392024-11-15T21:42:06.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 937.170192ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
17402024-11-15T21:42:06.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 1.175736012s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
17412024-11-15T21:42:07.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 856.476113ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
17422024-11-15T21:42:07.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 988.048546ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
17432024-11-15T21:42:07.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea") failed: Property not found. retry in 1.297316674s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
17442024-11-15T21:42:07.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 598.627884ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
17452024-11-15T21:42:07.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 959.540691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
17462024-11-15T21:42:07.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 903.479767ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
17472024-11-15T21:42:07.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 1.39956569s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
17482024-11-15T21:42:07.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 510.322286ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
17492024-11-15T21:42:07.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 1.025146807s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
17502024-11-15T21:42:08.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df") failed: Property not found. retry in 1.121453948s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
17512024-11-15T21:42:08.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 925.932404ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
17522024-11-15T21:42:08.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 733.137102ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
17532024-11-15T21:42:08.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 809.841853ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
17542024-11-15T21:42:08.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 1.486810225s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
17552024-11-15T21:42:08.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 1.446191574s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
17562024-11-15T21:42:09.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 1.46657447s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
17572024-11-15T21:42:09.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 675.804986ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
17582024-11-15T21:42:09.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 876.196514ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
17592024-11-15T21:42:09.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 1.250160276s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
17602024-11-15T21:42:09.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 644.824932ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
17612024-11-15T21:42:10.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e") failed: Property not found. retry in 870.215809ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
17622024-11-15T21:42:10.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095") failed: Property not found. retry in 1.492023732s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
17632024-11-15T21:42:10.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb") failed: Property not found. retry in 1.197836308s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
17642024-11-15T21:42:10.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778") failed: Property not found. retry in 1.17158745s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
17652024-11-15T21:42:10.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f") failed: Property not found. retry in 1.490548143s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
17662024-11-15T21:42:10.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77") failed: Property not found. retry in 574.122922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
17672024-11-15T21:42:12.175ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_7537c9dd-3abc-47e4-9cc2-101817dbe35f
17682024-11-15T21:42:12.175ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_ea922465-b1d2-4ae2-b8a8-45e2f520cd4c
17692024-11-15T21:42:12.175ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_e4339503-4d10-45c8-9546-38d7307ffa2e
17702024-11-15T21:42:12.175ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_fde33484-47f3-4b98-8d55-f6291a155ff1
17712024-11-15T21:42:12.175ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_2c97a782-015d-457b-aeff-76499dab0254
17722024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_fc42bd69-5037-4101-8fbb-5445b7048efd
17732024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_3b311d1f-8d53-42e1-9f16-4ab110060a18
17742024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_94ba37d9-0908-49bf-9275-523638ae5095
17752024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_d83efccf-9cd0-4a3c-973e-84dbe2b4483c
17762024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_8c657caf-7c63-43b2-9856-57cce1c7d867
17772024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_d27385ac-d3f8-425a-9c62-c86cb4a78778
17782024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_aa8ce9ac-5427-43e3-b71a-a158955330df
17792024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_4d944bfa-6a16-4d5e-8e7e-ce5391f301ea
17802024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_5e055384-7079-47b2-95bf-5191a730e1f0
17812024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_5a7571a8-c048-48d8-a4d1-00692f1c218e
17822024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b062ef64-d9cf-4a53-8c51-d7f366eafb77
17832024-11-15T21:42:12.178ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_7db095ef-0c07-408e-a294-6f51716fa8a4
17842024-11-15T21:42:12.181ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_68c7b7cc-2abf-457c-86ef-34c9e3f29f13
17852024-11-15T21:42:12.181ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_5ef543c6-773f-4453-b7c6-1ba24a407ceb
17862024-11-15T21:42:12.181ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17872024-11-15T21:42:12.184ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17882024-11-15T21:42:12.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37397448 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51045 req_id = ca26aae8-4d2c-4f59-8988-e4114e2fd550 response_code = 204 uri = /omicron-zones
17892024-11-15T21:42:12.221ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
17902024-11-15T21:42:12.221ZINFOSledAgent (RSS): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17912024-11-15T21:42:12.222ZINFOSledAgent (RSS): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17922024-11-15T21:42:12.431ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
17932024-11-15T21:42:12.436ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
17942024-11-15T21:42:12.489ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
17952024-11-15T21:42:13.867ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17962024-11-15T21:42:13.954ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17972024-11-15T21:42:14.082ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17982024-11-15T21:42:14.156ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17992024-11-15T21:42:14.342ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18002024-11-15T21:42:14.533ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18012024-11-15T21:42:14.704ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18022024-11-15T21:42:15.091ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18032024-11-15T21:42:15.528ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18042024-11-15T21:42:16.043ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18052024-11-15T21:42:16.705ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18062024-11-15T21:42:17.372ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18072024-11-15T21:42:17.818ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/ddfb397a-b658-4566-9e9b-db5e51d8a967/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18082024-11-15T21:42:18.173ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/probe_manager.rs:231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
18092024-11-15T21:42:18.553ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/78d47478-5af8-488d-89c5-11be23443b63) file = sled-agent/src/nexus.rs:527 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
18102024-11-15T21:42:20.523ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5f12cf2e-1c65-436d-8cb2-2d6c44faa5be", "content-length": "173", "date": "Fri, 15 Nov 2024 21:42:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"ddfb397a-b658-4566-9e9b-db5e51d8a967\"", request_id: "5f12cf2e-1c65-436d-8cb2-2d6c44faa5be" } file = sled-agent/src/rack_setup/service.rs:1075
18112024-11-15T21:42:21.539ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
18122024-11-15T21:42:21.938ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b6fa4268-66e3-4815-8eab-c7753d3fd0b2", "content-length": "173", "date": "Fri, 15 Nov 2024 21:42:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"ddfb397a-b658-4566-9e9b-db5e51d8a967\"", request_id: "b6fa4268-66e3-4815-8eab-c7753d3fd0b2" } file = sled-agent/src/rack_setup/service.rs:1075
18132024-11-15T21:42:23.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57349
18142024-11-15T21:42:23.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2735 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57349 req_id = c0826ad5-7055-4632-97ea-8eafb23ead68 response_code = 200 uri = /vpc-routes
18152024-11-15T21:42:23.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61864
18162024-11-15T21:42:23.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61864 req_id = 51e97b3e-ceb0-4dd0-8807-93e6be003766 response_code = 200 uri = /vpc-routes
18172024-11-15T21:42:23.237ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
18182024-11-15T21:42:23.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57349 req_id = a12081b1-8a30-4a6e-a413-32703bb96c73 response_code = 204 uri = /eip-gateways
18192024-11-15T21:42:23.237ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
18202024-11-15T21:42:23.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61864 req_id = 689fc3de-935e-448d-b51f-200d144339cd response_code = 204 uri = /eip-gateways
18212024-11-15T21:42:23.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41879
18222024-11-15T21:42:23.261ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18232024-11-15T21:42:23.261ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18242024-11-15T21:42:23.261ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:177
18252024-11-15T21:42:23.262ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:177
18262024-11-15T21:42:23.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59455
18272024-11-15T21:42:23.271ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18282024-11-15T21:42:23.271ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18292024-11-15T21:42:23.271ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:177
18302024-11-15T21:42:23.273ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:177
18312024-11-15T21:42:23.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45227
18322024-11-15T21:42:23.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45227 req_id = ab9a9b54-81d0-48f3-aca8-521e3c27bb50 response_code = 200 uri = /vpc-routes
18332024-11-15T21:42:23.277ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18342024-11-15T21:42:23.278ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50
18352024-11-15T21:42:23.304ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18362024-11-15T21:42:23.304ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50
18372024-11-15T21:42:23.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34925
18382024-11-15T21:42:23.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34925 req_id = a2ed2267-988a-4072-a31c-89186e2146a7 response_code = 200 uri = /v2p
18392024-11-15T21:42:23.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40477
18402024-11-15T21:42:23.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40477 req_id = 5e4f4a4c-ef3b-4a7c-9708-fb0c8279980b response_code = 200 uri = /v2p
18412024-11-15T21:42:23.339ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18422024-11-15T21:42:23.339ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9
18432024-11-15T21:42:23.363ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18442024-11-15T21:42:23.363ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9
18452024-11-15T21:42:23.386ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18462024-11-15T21:42:23.386ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876
18472024-11-15T21:42:23.401ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
18482024-11-15T21:42:23.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45227 req_id = 47cee589-eafc-4c91-bcab-73842339af4a response_code = 204 uri = /eip-gateways
18492024-11-15T21:42:23.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33785
18502024-11-15T21:42:23.409ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18512024-11-15T21:42:23.409ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876
18522024-11-15T21:42:23.429ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18532024-11-15T21:42:23.429ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18542024-11-15T21:42:23.429ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:177
18552024-11-15T21:42:23.434ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18562024-11-15T21:42:23.435ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8601efa0-7d56-406c-bb55-59ecc862a206
18572024-11-15T21:42:23.441ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:177
18582024-11-15T21:42:23.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57349 req_id = 01315940-dacf-47a2-bf90-34ec0386fa64 response_code = 204 uri = /vpc-routes
18592024-11-15T21:42:23.456ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18602024-11-15T21:42:23.456ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8601efa0-7d56-406c-bb55-59ecc862a206
18612024-11-15T21:42:23.461ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18622024-11-15T21:42:23.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61864 req_id = 943c7ab8-1201-44a3-bae0-fb5b37504352 response_code = 204 uri = /vpc-routes
18632024-11-15T21:42:23.475ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18642024-11-15T21:42:23.475ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50
18652024-11-15T21:42:23.498ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18662024-11-15T21:42:23.498ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3554a27f-cc97-4d5f-b65f-742b39508465
18672024-11-15T21:42:23.517ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18682024-11-15T21:42:23.517ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3554a27f-cc97-4d5f-b65f-742b39508465
18692024-11-15T21:42:23.534ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18702024-11-15T21:42:23.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1765 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45227 req_id = debe2d83-4f0b-4405-8699-637f22985b37 response_code = 204 uri = /vpc-routes
18712024-11-15T21:42:23.539ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18722024-11-15T21:42:23.539ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9
18732024-11-15T21:42:23.557ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18742024-11-15T21:42:23.557ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_85716c71-25b7-416c-85b5-8758a81c43ee
18752024-11-15T21:42:23.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55250
18762024-11-15T21:42:23.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55250 req_id = 26162615-1e03-41f4-8af9-ffeb9256c32e response_code = 200 uri = /v2p
18772024-11-15T21:42:23.575ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18782024-11-15T21:42:23.575ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_85716c71-25b7-416c-85b5-8758a81c43ee
18792024-11-15T21:42:23.596ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18802024-11-15T21:42:23.596ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876
18812024-11-15T21:42:23.612ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18822024-11-15T21:42:23.612ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75d1b97e-8e16-4b27-ad0e-659366660685
18832024-11-15T21:42:23.629ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18842024-11-15T21:42:23.629ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75d1b97e-8e16-4b27-ad0e-659366660685
18852024-11-15T21:42:23.645ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18862024-11-15T21:42:23.645ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c
18872024-11-15T21:42:23.660ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18882024-11-15T21:42:23.660ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8601efa0-7d56-406c-bb55-59ecc862a206
18892024-11-15T21:42:23.677ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18902024-11-15T21:42:23.677ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c
18912024-11-15T21:42:23.691ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18922024-11-15T21:42:23.691ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_07f78be9-2bf1-4fec-908e-2af18da98913
18932024-11-15T21:42:23.708ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18942024-11-15T21:42:23.708ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3554a27f-cc97-4d5f-b65f-742b39508465
18952024-11-15T21:42:23.724ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18962024-11-15T21:42:23.724ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_07f78be9-2bf1-4fec-908e-2af18da98913
18972024-11-15T21:42:23.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 457151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59455 req_id = 04182ac4-caaa-4723-a09e-b24ac69c3aeb response_code = 200 uri = /inventory
18982024-11-15T21:42:23.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 485709 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41879 req_id = fadea6ac-51ba-4617-96b9-e671c675b83a response_code = 200 uri = /inventory
18992024-11-15T21:42:23.752ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19002024-11-15T21:42:23.752ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_85716c71-25b7-416c-85b5-8758a81c43ee
19012024-11-15T21:42:23.777ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19022024-11-15T21:42:23.777ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75d1b97e-8e16-4b27-ad0e-659366660685
19032024-11-15T21:42:23.803ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19042024-11-15T21:42:23.803ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c
19052024-11-15T21:42:23.827ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19062024-11-15T21:42:23.827ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_07f78be9-2bf1-4fec-908e-2af18da98913
19072024-11-15T21:42:23.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 436212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33785 req_id = 3baa8084-d347-4d5d-aa86-9b1c31334114 response_code = 200 uri = /inventory
19082024-11-15T21:42:24.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46424
19092024-11-15T21:42:24.548ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19102024-11-15T21:42:24.548ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19112024-11-15T21:42:24.548ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:177
19122024-11-15T21:42:24.548ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:177
19132024-11-15T21:42:24.560ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19142024-11-15T21:42:24.560ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50
19152024-11-15T21:42:24.587ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19162024-11-15T21:42:24.587ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9
19172024-11-15T21:42:24.611ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19182024-11-15T21:42:24.611ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876
19192024-11-15T21:42:24.634ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19202024-11-15T21:42:24.634ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8601efa0-7d56-406c-bb55-59ecc862a206
19212024-11-15T21:42:24.658ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19222024-11-15T21:42:24.658ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3554a27f-cc97-4d5f-b65f-742b39508465
19232024-11-15T21:42:24.686ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19242024-11-15T21:42:24.686ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_85716c71-25b7-416c-85b5-8758a81c43ee
19252024-11-15T21:42:24.711ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19262024-11-15T21:42:24.711ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75d1b97e-8e16-4b27-ad0e-659366660685
19272024-11-15T21:42:24.735ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19282024-11-15T21:42:24.735ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c
19292024-11-15T21:42:24.761ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19302024-11-15T21:42:24.761ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_07f78be9-2bf1-4fec-908e-2af18da98913
19312024-11-15T21:42:24.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226059 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46424 req_id = 25454293-f204-4650-a792-77f870a4ffd0 response_code = 200 uri = /inventory
19322024-11-15T21:42:25.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64264
19332024-11-15T21:42:25.513ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19342024-11-15T21:42:25.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19352024-11-15T21:42:25.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19362024-11-15T21:42:25.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19372024-11-15T21:42:25.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19382024-11-15T21:42:25.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19392024-11-15T21:42:25.513ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19402024-11-15T21:42:25.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64264 req_id = 89d48fa2-8a06-4c27-ab3e-66171bb203cd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19412024-11-15T21:42:25.516ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
19422024-11-15T21:42:25.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47356
19432024-11-15T21:42:25.748ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19442024-11-15T21:42:25.748ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19452024-11-15T21:42:25.748ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:177
19462024-11-15T21:42:25.748ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:177
19472024-11-15T21:42:25.760ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19482024-11-15T21:42:25.760ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50
19492024-11-15T21:42:25.789ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19502024-11-15T21:42:25.789ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9
19512024-11-15T21:42:25.815ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19522024-11-15T21:42:25.815ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876
19532024-11-15T21:42:25.840ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19542024-11-15T21:42:25.840ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8601efa0-7d56-406c-bb55-59ecc862a206
19552024-11-15T21:42:25.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33592
19562024-11-15T21:42:25.845ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19572024-11-15T21:42:25.845ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19582024-11-15T21:42:25.845ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19592024-11-15T21:42:25.845ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19602024-11-15T21:42:25.845ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19612024-11-15T21:42:25.845ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19622024-11-15T21:42:25.845ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19632024-11-15T21:42:25.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 406 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33592 req_id = ebfd5beb-60f7-4f6c-84ed-2623277f0b40 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19642024-11-15T21:42:25.865ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19652024-11-15T21:42:25.865ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3554a27f-cc97-4d5f-b65f-742b39508465
19662024-11-15T21:42:25.888ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19672024-11-15T21:42:25.888ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_85716c71-25b7-416c-85b5-8758a81c43ee
19682024-11-15T21:42:25.912ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19692024-11-15T21:42:25.912ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75d1b97e-8e16-4b27-ad0e-659366660685
19702024-11-15T21:42:25.935ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19712024-11-15T21:42:25.935ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c
19722024-11-15T21:42:25.960ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19732024-11-15T21:42:25.960ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_07f78be9-2bf1-4fec-908e-2af18da98913
19742024-11-15T21:42:25.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224992 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47356 req_id = 30b6695b-0db0-4138-9e6a-84bf2c7187bc response_code = 200 uri = /inventory
19752024-11-15T21:42:26.747ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60948
19762024-11-15T21:42:26.747ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19772024-11-15T21:42:26.748ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19782024-11-15T21:42:26.748ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19792024-11-15T21:42:26.748ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19802024-11-15T21:42:26.748ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19812024-11-15T21:42:26.748ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19822024-11-15T21:42:26.748ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19832024-11-15T21:42:26.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60948 req_id = 35187084-c4bd-4684-8951-a7ea430faf1e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19842024-11-15T21:42:27.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33451
19852024-11-15T21:42:27.429ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19862024-11-15T21:42:27.429ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19872024-11-15T21:42:27.429ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19882024-11-15T21:42:27.429ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19892024-11-15T21:42:27.429ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19902024-11-15T21:42:27.429ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19912024-11-15T21:42:27.429ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19922024-11-15T21:42:27.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33451 req_id = 7a142b77-aac9-4928-a151-8a3f58a5ce39 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19932024-11-15T21:42:31.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33840
19942024-11-15T21:42:31.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33840 req_id = efcdf83e-3847-40f2-b50b-8b60944a03ea response_code = 200 uri = /vpc-routes
19952024-11-15T21:42:31.879ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
19962024-11-15T21:42:31.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33840 req_id = 51a92875-52ea-46bc-80ef-2a400850415b response_code = 204 uri = /eip-gateways
19972024-11-15T21:42:31.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33840 req_id = e310b146-170a-4f61-8e9f-8ad7f8ce51cb response_code = 204 uri = /vpc-routes
19982024-11-15T21:42:34.921ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53307
19992024-11-15T21:42:34.921ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53307 req_id = 5e8d5b44-9e36-4b6c-8a11-074743ddd14b response_code = 200 uri = /baseboard
20002024-11-15T21:42:50.745ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:59011 remote_addr = [fd00:1122:3344:101::d]:38654 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
20012024-11-15T21:42:50.770ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25363 local_addr = [fd00:1122:3344:101::1]:59011 method = GET remote_addr = [fd00:1122:3344:101::d]:38654 req_id = 0043be51-0fe7-402e-b35d-730d559c17bd response_code = 200 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 uri = /78d47478-5af8-488d-89c5-11be23443b63
20022024-11-15T21:42:52.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62723
20032024-11-15T21:42:52.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62723 req_id = 7f30acec-640e-42e0-8c03-2d1efe79193c response_code = 200 uri = /vpc-routes
20042024-11-15T21:42:53.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41028
20052024-11-15T21:42:53.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41028 req_id = 50716a59-58a2-4aae-baf3-5a8a191d30e8 response_code = 200 uri = /vpc-routes
20062024-11-15T21:42:53.031ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
20072024-11-15T21:42:53.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41028 req_id = c4abe443-f821-49c0-90f9-0a1068275558 response_code = 204 uri = /eip-gateways
20082024-11-15T21:42:53.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41028 req_id = 2575f276-4b69-4436-8de1-7c2efb5a7dd6 response_code = 204 uri = /vpc-routes
20092024-11-15T21:42:53.062ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
20102024-11-15T21:42:53.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62723 req_id = a1dd900a-851f-4570-928f-f83416ff31db response_code = 204 uri = /eip-gateways
20112024-11-15T21:42:53.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45671
20122024-11-15T21:42:53.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45671 req_id = 049e557b-0654-473a-970c-7ab07ddcb866 response_code = 200 uri = /v2p
20132024-11-15T21:42:53.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62723 req_id = 7bea9db7-f47f-4513-b51c-e7de262261a3 response_code = 204 uri = /vpc-routes
20142024-11-15T21:42:53.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41803
20152024-11-15T21:42:53.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41803 req_id = 3c96f28b-b306-4ce2-9fd5-22973e38928a response_code = 200 uri = /v2p
20162024-11-15T21:42:53.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42718
20172024-11-15T21:42:53.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42718 req_id = 83fa7fb2-f98e-41bc-9cb2-828a83357535 response_code = 200 uri = /vpc-routes
20182024-11-15T21:42:53.264ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
20192024-11-15T21:42:53.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42718 req_id = 1668072c-5d1d-41e0-a135-f49516e59847 response_code = 204 uri = /eip-gateways
20202024-11-15T21:42:53.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34830
20212024-11-15T21:42:53.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34830 req_id = ad497231-2a3e-4276-863d-1dc6266e4ed1 response_code = 200 uri = /v2p
20222024-11-15T21:42:53.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42718 req_id = a202cc8b-0b32-46dc-997c-388c625c1924 response_code = 204 uri = /vpc-routes
20232024-11-15T21:42:53.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40149
20242024-11-15T21:42:53.388ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20252024-11-15T21:42:53.477ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20262024-11-15T21:42:53.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156305 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40149 req_id = b1c4d767-0b6b-4251-bb24-111b316228df response_code = 204 uri = /switch-ports
20272024-11-15T21:42:53.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61995
20282024-11-15T21:42:53.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49432
20292024-11-15T21:42:53.543ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20302024-11-15T21:42:53.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4601 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40149 req_id = ae4e54a6-26e0-4f11-b3f5-aae14984c288 response_code = 200 uri = /network-bootstore-config
20312024-11-15T21:42:53.589ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20322024-11-15T21:42:53.600ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
20332024-11-15T21:42:53.600ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20342024-11-15T21:42:53.601ZINFOSledAgent (bootstore): Writing ledger to /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
20352024-11-15T21:42:53.606ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
20362024-11-15T21:42:53.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8598 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40149 req_id = bbb42f4a-5ae2-4280-8b06-ae6740c60abf response_code = 204 uri = /network-bootstore-config
20372024-11-15T21:42:53.646ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20382024-11-15T21:42:53.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103396 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49432 req_id = ea67b5ae-1f6a-4371-ba28-ca2396ca8f65 response_code = 204 uri = /switch-ports
20392024-11-15T21:42:53.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 599 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49432 req_id = 79405e5b-ce95-474d-8e4b-81771d1bfd27 response_code = 200 uri = /network-bootstore-config
20402024-11-15T21:42:53.681ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20412024-11-15T21:42:53.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192756 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61995 req_id = 00a8cd46-4a9a-4c55-bce8-26d1702d85e2 response_code = 204 uri = /switch-ports
20422024-11-15T21:42:53.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61995 req_id = 11281a08-1697-426b-89bf-b38c718581a3 response_code = 200 uri = /network-bootstore-config
20432024-11-15T21:43:04.972ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62111
20442024-11-15T21:43:04.973ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62111 req_id = 6e83c71e-1417-48d0-8cc9-211724a21d95 response_code = 200 uri = /baseboard
20452024-11-15T21:43:20.600ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20462024-11-15T21:43:22.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33385
20472024-11-15T21:43:22.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33385 req_id = 6ad51081-5d3b-4e29-a5f7-23ae9aeb63b9 response_code = 200 uri = /vpc-routes
20482024-11-15T21:43:23.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48689
20492024-11-15T21:43:23.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48689 req_id = d727302a-1fab-473d-86e7-6a25da7e5949 response_code = 200 uri = /vpc-routes
20502024-11-15T21:43:23.144ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
20512024-11-15T21:43:23.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48689 req_id = 3f1dd265-39a4-434a-a2b2-9399d22f6cad response_code = 204 uri = /eip-gateways
20522024-11-15T21:43:23.158ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
20532024-11-15T21:43:23.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33385 req_id = d476c964-6687-4cef-9d74-67da2bf14122 response_code = 204 uri = /eip-gateways
20542024-11-15T21:43:23.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48689 req_id = 12f0d2a0-cf25-4065-98b0-af5dc3b17fe2 response_code = 204 uri = /vpc-routes
20552024-11-15T21:43:23.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50229
20562024-11-15T21:43:23.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50229 req_id = ae4fa888-54b0-4d5e-88b5-0590dd48997c response_code = 200 uri = /v2p
20572024-11-15T21:43:23.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33385 req_id = 7243c02e-2493-41f2-bc78-18463e61b28a response_code = 204 uri = /vpc-routes
20582024-11-15T21:43:23.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50105
20592024-11-15T21:43:23.228ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20602024-11-15T21:43:23.272ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20612024-11-15T21:43:23.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99125 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50105 req_id = b2e65ea4-7c9a-47f3-8b5d-fd2903263ebb response_code = 204 uri = /switch-ports
20622024-11-15T21:43:23.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46242
20632024-11-15T21:43:23.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52606
20642024-11-15T21:43:23.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20652024-11-15T21:43:23.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50105 req_id = 454fb566-84a5-44a8-97ef-d7a56c39bc64 response_code = 200 uri = /network-bootstore-config
20662024-11-15T21:43:23.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 601 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52606 req_id = d9429b49-881f-4b95-8894-1d157afb9f4f response_code = 200 uri = /v2p
20672024-11-15T21:43:23.364ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20682024-11-15T21:43:23.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33578
20692024-11-15T21:43:23.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33578 req_id = 40f5fca6-dcc7-4f49-b74d-94fd7f536c3e response_code = 200 uri = /vpc-routes
20702024-11-15T21:43:23.388ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
20712024-11-15T21:43:23.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33578 req_id = f84aca95-3591-4f68-9b21-8444e92285b3 response_code = 204 uri = /eip-gateways
20722024-11-15T21:43:23.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33578 req_id = c4eee762-e18d-4ac3-82bb-026b660cb2b3 response_code = 204 uri = /vpc-routes
20732024-11-15T21:43:23.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97657 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46242 req_id = 079fed61-c1ff-4fa3-8530-485c391ef6b6 response_code = 204 uri = /switch-ports
20742024-11-15T21:43:23.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46242 req_id = b73c9e7e-4701-4086-944c-3048577e84dd response_code = 200 uri = /network-bootstore-config
20752024-11-15T21:43:23.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34248
20762024-11-15T21:43:23.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34248 req_id = 10655e7f-5114-464a-809a-401fe378a02e response_code = 200 uri = /v2p
20772024-11-15T21:43:23.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40275
20782024-11-15T21:43:23.604ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20792024-11-15T21:43:23.638ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20802024-11-15T21:43:23.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40275 req_id = d9d65d55-466f-4d5d-ab2c-75aca67ce7f5 response_code = 204 uri = /switch-ports
20812024-11-15T21:43:23.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40275 req_id = 12ee55b6-2f93-41f9-be9c-fd0d5c38f4ac response_code = 200 uri = /network-bootstore-config
20822024-11-15T21:43:35.006ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57917
20832024-11-15T21:43:35.006ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57917 req_id = b043590b-c3d6-4edd-96c1-d36066119845 response_code = 200 uri = /baseboard
20842024-11-15T21:43:52.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59716
20852024-11-15T21:43:52.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59716 req_id = d97fefb9-44ab-42ee-8acc-6260c5e89630 response_code = 200 uri = /vpc-routes
20862024-11-15T21:43:52.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56811
20872024-11-15T21:43:52.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56811 req_id = a96580c7-faf6-460e-86af-d3a627a475b6 response_code = 200 uri = /vpc-routes
20882024-11-15T21:43:52.958ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
20892024-11-15T21:43:52.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56811 req_id = 6597e7bc-958c-47e9-a36c-da706b93f0d3 response_code = 204 uri = /eip-gateways
20902024-11-15T21:43:52.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56811 req_id = fcef51ef-7af5-42a0-bf35-d8a4d09e3665 response_code = 204 uri = /vpc-routes
20912024-11-15T21:43:53.026ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
20922024-11-15T21:43:53.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59716 req_id = b356b8e2-eda1-42e4-b25c-19b420b60ee0 response_code = 204 uri = /eip-gateways
20932024-11-15T21:43:53.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59716 req_id = fe37ac6c-4ad5-4820-a9cf-b59bdf397c96 response_code = 204 uri = /vpc-routes
20942024-11-15T21:43:53.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47947
20952024-11-15T21:43:53.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47947 req_id = 0233eb1b-0c36-4c96-9997-fd8715f7df67 response_code = 200 uri = /v2p
20962024-11-15T21:43:53.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48597
20972024-11-15T21:43:53.100ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20982024-11-15T21:43:53.139ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20992024-11-15T21:43:53.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94422 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48597 req_id = 5e665fec-74af-4aab-b54e-be03ef8d59a5 response_code = 204 uri = /switch-ports
21002024-11-15T21:43:53.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54885
21012024-11-15T21:43:53.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61544
21022024-11-15T21:43:53.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61544 req_id = 582e3802-e81a-4a27-bd40-c6413e8f6b1c response_code = 200 uri = /v2p
21032024-11-15T21:43:53.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48597 req_id = 6601f669-5349-4353-b952-0f74892bbe20 response_code = 200 uri = /network-bootstore-config
21042024-11-15T21:43:53.195ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21052024-11-15T21:43:53.231ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21062024-11-15T21:43:53.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51804
21072024-11-15T21:43:53.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51804 req_id = 5d5d3f33-1037-4cc7-abd1-e90a8fe962fa response_code = 200 uri = /vpc-routes
21082024-11-15T21:43:53.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87820 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54885 req_id = 83cebcff-2760-41b5-94c6-b702d4bc4f17 response_code = 204 uri = /switch-ports
21092024-11-15T21:43:53.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54885 req_id = f8895fd5-1b6e-488a-b9c0-61a027b3e84d response_code = 200 uri = /network-bootstore-config
21102024-11-15T21:43:53.330ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
21112024-11-15T21:43:53.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51804 req_id = 694a862f-4c77-4205-bd2c-642faa455cdb response_code = 204 uri = /eip-gateways
21122024-11-15T21:43:53.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51804 req_id = 8254f191-65e2-4b3f-b0bb-2d961d5f0d6b response_code = 204 uri = /vpc-routes
21132024-11-15T21:43:53.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33045
21142024-11-15T21:43:53.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33045 req_id = c77b0de9-1bd3-4ded-9042-ac4a9340c066 response_code = 200 uri = /v2p
21152024-11-15T21:43:53.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34212
21162024-11-15T21:43:53.425ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21172024-11-15T21:43:53.462ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21182024-11-15T21:43:53.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91811 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34212 req_id = 80344357-62c5-4448-b3db-5cb009704ee2 response_code = 204 uri = /switch-ports
21192024-11-15T21:43:53.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34212 req_id = 802a61bd-19fb-4c7c-9d39-1d8f6d8a12e6 response_code = 200 uri = /network-bootstore-config
21202024-11-15T21:44:05.039ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54889
21212024-11-15T21:44:05.039ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54889 req_id = c5ce4d1c-0142-4adf-8dce-8ebb23d59cd3 response_code = 200 uri = /baseboard
21222024-11-15T21:44:23.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53940
21232024-11-15T21:44:23.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53940 req_id = 494ed00f-c51e-464f-92e4-0bde43c9ac95 response_code = 200 uri = /vpc-routes
21242024-11-15T21:44:23.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44609
21252024-11-15T21:44:23.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44609 req_id = ac168472-0eaf-4608-b5a2-e577fbf056be response_code = 200 uri = /vpc-routes
21262024-11-15T21:44:23.259ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
21272024-11-15T21:44:23.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44609 req_id = b6b88d50-4a54-4276-bed7-ba73784c4df6 response_code = 204 uri = /eip-gateways
21282024-11-15T21:44:23.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44609 req_id = 21dd7ead-801b-4816-b6c5-7b8f7b5b3588 response_code = 204 uri = /vpc-routes
21292024-11-15T21:44:23.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49574
21302024-11-15T21:44:23.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49574 req_id = 60d66642-e9a7-40df-9856-f9357f48472b response_code = 200 uri = /v2p
21312024-11-15T21:44:23.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
21322024-11-15T21:44:23.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53940 req_id = d098bc94-f7f4-4b93-8675-f26c46ee2ac2 response_code = 204 uri = /eip-gateways
21332024-11-15T21:44:23.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53940 req_id = 8c7ed76f-6d33-4676-b406-3a76b19a6ae9 response_code = 204 uri = /vpc-routes
21342024-11-15T21:44:23.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45539
21352024-11-15T21:44:23.349ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21362024-11-15T21:44:23.386ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21372024-11-15T21:44:23.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92338 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45539 req_id = aa294312-9bba-43ee-be60-aadb5719bc70 response_code = 204 uri = /switch-ports
21382024-11-15T21:44:23.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60151
21392024-11-15T21:44:23.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61872
21402024-11-15T21:44:23.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7459 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45539 req_id = d434060c-288a-44b5-a42c-d2da5e4626e9 response_code = 200 uri = /network-bootstore-config
21412024-11-15T21:44:23.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 422 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61872 req_id = eda811a2-73d4-4939-b06f-4e69cc9594ec response_code = 200 uri = /vpc-routes
21422024-11-15T21:44:23.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60151 req_id = cc629077-7d7f-4f6d-9261-ddaa892329b1 response_code = 200 uri = /v2p
21432024-11-15T21:44:23.499ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
21442024-11-15T21:44:23.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61872 req_id = 662a1501-8d69-4071-911b-d05dcf336de1 response_code = 204 uri = /eip-gateways
21452024-11-15T21:44:23.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61872 req_id = 7bdd9b43-e53b-4bc8-a4fa-a61fdd237608 response_code = 204 uri = /vpc-routes
21462024-11-15T21:44:23.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59217
21472024-11-15T21:44:23.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59217 req_id = 9042ff37-47c2-4b48-b880-f719d608cd97 response_code = 200 uri = /v2p
21482024-11-15T21:44:23.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50344
21492024-11-15T21:44:23.562ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21502024-11-15T21:44:23.600ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21512024-11-15T21:44:23.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92931 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50344 req_id = ea4cffb1-0bbc-4011-a31a-26b3ae36d046 response_code = 204 uri = /switch-ports
21522024-11-15T21:44:23.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47297
21532024-11-15T21:44:23.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50344 req_id = d35dde33-382e-4715-ab9d-97b37da0f384 response_code = 200 uri = /network-bootstore-config
21542024-11-15T21:44:23.656ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21552024-11-15T21:44:23.690ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21562024-11-15T21:44:23.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87523 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47297 req_id = 3b699999-8208-4d9f-8257-6a77c4f657b1 response_code = 204 uri = /switch-ports
21572024-11-15T21:44:23.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47297 req_id = 2521a8a8-76c6-422a-9b16-b8fc8bf3a95f response_code = 200 uri = /network-bootstore-config
21582024-11-15T21:44:35.071ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38512
21592024-11-15T21:44:35.071ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38512 req_id = 2da85c9a-f2d5-4cb1-8a41-46a93d84eeed response_code = 200 uri = /baseboard
21602024-11-15T21:44:52.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61861
21612024-11-15T21:44:52.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61861 req_id = dca23e9d-6241-471d-929d-fc542b259c89 response_code = 200 uri = /vpc-routes
21622024-11-15T21:44:52.966ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
21632024-11-15T21:44:52.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61861 req_id = 98244607-e19a-4e5b-bf4b-9c27741b8a68 response_code = 204 uri = /eip-gateways
21642024-11-15T21:44:52.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61861 req_id = 10623c12-0ca8-4370-87bd-0b728d70f006 response_code = 204 uri = /vpc-routes
21652024-11-15T21:44:53.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61866
21662024-11-15T21:44:53.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61866 req_id = 01dd4863-3a8c-4d19-a849-5c8d993fb3bd response_code = 200 uri = /vpc-routes
21672024-11-15T21:44:53.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64179
21682024-11-15T21:44:53.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64179 req_id = 1ef21da9-a23b-4435-b5e9-327eaed93137 response_code = 200 uri = /v2p
21692024-11-15T21:44:53.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44503
21702024-11-15T21:44:53.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44503 req_id = 425f6533-f7d6-4f28-82a9-e278273aaad1 response_code = 200 uri = /v2p
21712024-11-15T21:44:53.138ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
21722024-11-15T21:44:53.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61866 req_id = f6005b54-4999-4ec7-b954-14828d6302ec response_code = 204 uri = /eip-gateways
21732024-11-15T21:44:53.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39484
21742024-11-15T21:44:53.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21752024-11-15T21:44:53.195ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21762024-11-15T21:44:53.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104958 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39484 req_id = 016a90e0-9729-4d5a-8cf7-7b71a9c0814e response_code = 204 uri = /switch-ports
21772024-11-15T21:44:53.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47928
21782024-11-15T21:44:53.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39484 req_id = e639a436-fb76-4fef-8b99-6ee4813163e6 response_code = 200 uri = /network-bootstore-config
21792024-11-15T21:44:53.258ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21802024-11-15T21:44:53.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 444 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61866 req_id = 042ccd7f-4603-4cfa-ac22-2a91b3ed7c50 response_code = 204 uri = /vpc-routes
21812024-11-15T21:44:53.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43908
21822024-11-15T21:44:53.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43908 req_id = be51c36b-2756-44ea-b156-565f5779e4ff response_code = 200 uri = /vpc-routes
21832024-11-15T21:44:53.297ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21842024-11-15T21:44:53.304ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
21852024-11-15T21:44:53.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43908 req_id = b913f79a-8da5-4171-b211-34f06d5f41f0 response_code = 204 uri = /eip-gateways
21862024-11-15T21:44:53.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43908 req_id = 4b830328-0a75-4137-8518-6b1f4eb356aa response_code = 204 uri = /vpc-routes
21872024-11-15T21:44:53.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91950 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47928 req_id = 89a44556-a24a-4f87-bc25-430789673b09 response_code = 204 uri = /switch-ports
21882024-11-15T21:44:53.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47928 req_id = 97ea3496-b4dc-4cbf-a8de-f68940c5ddc5 response_code = 200 uri = /network-bootstore-config
21892024-11-15T21:44:53.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46174
21902024-11-15T21:44:53.367ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21912024-11-15T21:44:53.400ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21922024-11-15T21:44:53.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84336 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46174 req_id = 6c6e32b5-7d59-4c16-94b2-f9d2308681ec response_code = 204 uri = /switch-ports
21932024-11-15T21:44:53.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45793
21942024-11-15T21:44:53.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45793 req_id = 19a49ec4-3049-4f00-98f3-b5e45565a185 response_code = 200 uri = /v2p
21952024-11-15T21:44:53.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46174 req_id = ddb6124c-2c1d-44bf-aff6-d8ca43d6c13a response_code = 200 uri = /network-bootstore-config
21962024-11-15T21:45:05.106ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43983
21972024-11-15T21:45:05.106ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43983 req_id = fb0ca41c-e532-41c2-9652-0d4893650b25 response_code = 200 uri = /baseboard
21982024-11-15T21:45:23.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59275
21992024-11-15T21:45:23.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59275 req_id = 8b7260f1-a779-4c61-a817-e445fe4303b6 response_code = 200 uri = /vpc-routes
22002024-11-15T21:45:23.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42195
22012024-11-15T21:45:23.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42195 req_id = 02d3e066-14f6-4f24-a415-9aab08746788 response_code = 200 uri = /vpc-routes
22022024-11-15T21:45:23.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64628
22032024-11-15T21:45:23.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64628 req_id = b788f6e0-5d7d-42a9-a9e8-32146ae29f65 response_code = 200 uri = /v2p
22042024-11-15T21:45:23.231ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
22052024-11-15T21:45:23.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42195 req_id = 03757959-4c7f-4cc2-adf1-6aa153651891 response_code = 204 uri = /eip-gateways
22062024-11-15T21:45:23.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42195 req_id = 853d9ac6-a094-4d09-bd6b-a99793b741e9 response_code = 204 uri = /vpc-routes
22072024-11-15T21:45:23.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51989
22082024-11-15T21:45:23.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51989 req_id = 20e2691a-a6b5-412c-97e1-da7d74bc06bd response_code = 200 uri = /v2p
22092024-11-15T21:45:23.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43208
22102024-11-15T21:45:23.330ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22112024-11-15T21:45:23.368ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22122024-11-15T21:45:23.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43208 req_id = ab8dcfc1-2663-4025-a67e-3462c6f4319d response_code = 204 uri = /switch-ports
22132024-11-15T21:45:23.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55965
22142024-11-15T21:45:23.422ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
22152024-11-15T21:45:23.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59275 req_id = 673d6e1d-c19c-4f36-bda7-1181b3a9d279 response_code = 204 uri = /eip-gateways
22162024-11-15T21:45:23.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43208 req_id = fc96ddce-577e-4b9b-ba9c-7592c4bb340e response_code = 200 uri = /network-bootstore-config
22172024-11-15T21:45:23.422ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22182024-11-15T21:45:23.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59275 req_id = b52bfb19-6b00-43e0-9ee4-0e510cdd37e0 response_code = 204 uri = /vpc-routes
22192024-11-15T21:45:23.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40782
22202024-11-15T21:45:23.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40782 req_id = 33ad1e4f-c51d-43f2-8999-c85b1b66989b response_code = 200 uri = /vpc-routes
22212024-11-15T21:45:23.463ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22222024-11-15T21:45:23.503ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
22232024-11-15T21:45:23.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40782 req_id = 7396b93d-6de1-4831-abbe-f226dbdddc33 response_code = 204 uri = /eip-gateways
22242024-11-15T21:45:23.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40782 req_id = 6e6fdde8-d380-4407-9f2a-40d69c8b5b52 response_code = 204 uri = /vpc-routes
22252024-11-15T21:45:23.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97033 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55965 req_id = caa64978-2d2b-42bd-b1e0-fcdd442a364b response_code = 204 uri = /switch-ports
22262024-11-15T21:45:23.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55965 req_id = 96cf5018-176a-4aca-b882-4f6400132c05 response_code = 200 uri = /network-bootstore-config
22272024-11-15T21:45:23.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44532
22282024-11-15T21:45:23.569ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22292024-11-15T21:45:23.605ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22302024-11-15T21:45:23.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88088 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44532 req_id = bcbe4d37-67d6-489a-bd88-8c60bf5946ab response_code = 204 uri = /switch-ports
22312024-11-15T21:45:23.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49291
22322024-11-15T21:45:23.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49291 req_id = ca6f8544-481d-494e-881a-19ab765f444c response_code = 200 uri = /v2p
22332024-11-15T21:45:23.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44532 req_id = 1548f97f-75ab-417f-addb-a7b8d5580bd7 response_code = 200 uri = /network-bootstore-config
22342024-11-15T21:45:35.160ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65329
22352024-11-15T21:45:35.160ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65329 req_id = eb843792-8547-4d5d-86d2-40177bda3848 response_code = 200 uri = /baseboard
22362024-11-15T21:45:52.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42083
22372024-11-15T21:45:52.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42083 req_id = 371868cf-4e41-4d5c-a30a-af1ecd3d1ca2 response_code = 200 uri = /vpc-routes
22382024-11-15T21:45:52.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42790
22392024-11-15T21:45:52.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42790 req_id = 549f3a5c-6a4a-4d06-a35c-4addf0dff471 response_code = 200 uri = /vpc-routes
22402024-11-15T21:45:52.953ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
22412024-11-15T21:45:52.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42083 req_id = ac3d6f02-6575-4d8a-9202-b7cc1e936c67 response_code = 204 uri = /eip-gateways
22422024-11-15T21:45:52.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42083 req_id = cb62a020-50b6-4ba3-98f1-6be7cca7aac8 response_code = 204 uri = /vpc-routes
22432024-11-15T21:45:52.994ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
22442024-11-15T21:45:52.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42790 req_id = 9fbde905-2ac5-48ca-9605-a2fb0187087e response_code = 204 uri = /eip-gateways
22452024-11-15T21:45:53.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42790 req_id = c189e834-3f0a-4b44-940f-b7884c2305f0 response_code = 204 uri = /vpc-routes
22462024-11-15T21:45:53.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50535
22472024-11-15T21:45:53.021ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22482024-11-15T21:45:53.070ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22492024-11-15T21:45:53.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127621 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50535 req_id = 7e5a78af-7575-4273-a26e-34ff46996a43 response_code = 204 uri = /switch-ports
22502024-11-15T21:45:53.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51588
22512024-11-15T21:45:53.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55742
22522024-11-15T21:45:53.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37185
22532024-11-15T21:45:53.149ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22542024-11-15T21:45:53.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50535 req_id = 5f57e76b-dd7d-435f-888e-11df13750b3e response_code = 200 uri = /network-bootstore-config
22552024-11-15T21:45:53.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5052 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55742 req_id = 2098eba9-c400-428d-ace3-48fa729843a2 response_code = 200 uri = /v2p
22562024-11-15T21:45:53.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51588 req_id = 9356c3a3-6071-410b-a50c-25ab98fa5cd4 response_code = 200 uri = /v2p
22572024-11-15T21:45:53.189ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22582024-11-15T21:45:53.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57421
22592024-11-15T21:45:53.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57421 req_id = f7a0239a-ca77-47ae-933b-b92e6e27e021 response_code = 200 uri = /vpc-routes
22602024-11-15T21:45:53.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98470 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37185 req_id = ea689ebe-e1fe-4662-9027-7a4a15ea446c response_code = 204 uri = /switch-ports
22612024-11-15T21:45:53.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37185 req_id = 1fd2d530-d826-45e7-b9dc-2c17738a1369 response_code = 200 uri = /network-bootstore-config
22622024-11-15T21:45:53.267ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
22632024-11-15T21:45:53.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57421 req_id = 1a2350d6-78c1-46f5-a7c3-b0580bf2f346 response_code = 204 uri = /eip-gateways
22642024-11-15T21:45:53.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64571
22652024-11-15T21:45:53.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64571 req_id = 44d23202-ffab-48a7-ab02-1ac32ce1be3b response_code = 200 uri = /v2p
22662024-11-15T21:45:53.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57421 req_id = 9fa1b2ae-bd5d-475d-95a9-d23b744e2858 response_code = 204 uri = /vpc-routes
22672024-11-15T21:45:53.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42427
22682024-11-15T21:45:53.404ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22692024-11-15T21:45:53.443ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22702024-11-15T21:45:53.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91767 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42427 req_id = 66da222f-14c2-4eea-9b7a-f26454f0dd24 response_code = 204 uri = /switch-ports
22712024-11-15T21:45:53.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42427 req_id = bddc5dbd-8af5-48da-a82c-7e9fc69e1e0d response_code = 200 uri = /network-bootstore-config
22722024-11-15T21:46:05.194ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35370
22732024-11-15T21:46:05.194ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35370 req_id = 9b33583a-24d8-4803-b17e-df191706c2e1 response_code = 200 uri = /baseboard
22742024-11-15T21:46:22.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56632
22752024-11-15T21:46:22.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56632 req_id = 910c9ab0-304e-42dd-92d3-f6a8f8b7d14f response_code = 200 uri = /vpc-routes
22762024-11-15T21:46:23.043ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
22772024-11-15T21:46:23.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56632 req_id = 1a19d269-827d-4a9f-b31a-5b5e9a595a15 response_code = 204 uri = /eip-gateways
22782024-11-15T21:46:23.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56632 req_id = 758a68bb-e789-4a55-9a61-4a35e4685ca7 response_code = 204 uri = /vpc-routes
22792024-11-15T21:46:23.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47385
22802024-11-15T21:46:23.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47385 req_id = db8ee7dd-1ac2-4ac4-bc03-1ad933aab8fb response_code = 200 uri = /v2p
22812024-11-15T21:46:23.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47863
22822024-11-15T21:46:23.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47863 req_id = a8b310a9-f2b8-4ead-b6f1-0259b8b37fc7 response_code = 200 uri = /vpc-routes
22832024-11-15T21:46:23.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45720
22842024-11-15T21:46:23.271ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22852024-11-15T21:46:23.314ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22862024-11-15T21:46:23.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102597 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45720 req_id = 7d1689d9-4abf-4f13-b2b4-6b4e05e12382 response_code = 204 uri = /switch-ports
22872024-11-15T21:46:23.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51102
22882024-11-15T21:46:23.374ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
22892024-11-15T21:46:23.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47863 req_id = 24f5966e-8b0a-412c-898b-6a5e2e9832e4 response_code = 204 uri = /eip-gateways
22902024-11-15T21:46:23.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61713
22912024-11-15T21:46:23.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45720 req_id = 48e5a203-5bbb-431d-83fd-aa84837bfa4d response_code = 200 uri = /network-bootstore-config
22922024-11-15T21:46:23.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22932024-11-15T21:46:23.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61713 req_id = a7808e56-a8be-428c-a538-c623898ff02c response_code = 200 uri = /v2p
22942024-11-15T21:46:23.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47863 req_id = 58870c64-97a6-4ec2-bafd-2ff8572b65ab response_code = 204 uri = /vpc-routes
22952024-11-15T21:46:23.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22962024-11-15T21:46:23.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51102 req_id = 52ff57a5-8163-49f3-8987-d7be6749a5f5 response_code = 204 uri = /switch-ports
22972024-11-15T21:46:23.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51102 req_id = 2b808502-70f0-4b18-bd2e-eb98403abce0 response_code = 200 uri = /network-bootstore-config
22982024-11-15T21:46:23.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54003
22992024-11-15T21:46:23.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54003 req_id = 8ba122c7-8d98-4b4d-9026-0bc682b500e0 response_code = 200 uri = /vpc-routes
23002024-11-15T21:46:23.513ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
23012024-11-15T21:46:23.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54003 req_id = f5c21aa9-b92d-43d3-8e4a-0f9b321339f1 response_code = 204 uri = /eip-gateways
23022024-11-15T21:46:23.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54003 req_id = 8c7251f7-d11f-4755-8871-68080c4a4ab8 response_code = 204 uri = /vpc-routes
23032024-11-15T21:46:23.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60811
23042024-11-15T21:46:23.586ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23052024-11-15T21:46:23.625ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23062024-11-15T21:46:23.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97708 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60811 req_id = c944548b-c3a8-45e8-93d8-c923664e365f response_code = 204 uri = /switch-ports
23072024-11-15T21:46:23.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60811 req_id = 4a910b0a-4613-4ba6-8a43-42c7981bcb9f response_code = 200 uri = /network-bootstore-config
23082024-11-15T21:46:23.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42470
23092024-11-15T21:46:23.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42470 req_id = 09a277cf-fcf3-4d5d-bbc7-378a64df131e response_code = 200 uri = /v2p
23102024-11-15T21:46:35.214ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32804
23112024-11-15T21:46:35.214ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32804 req_id = 68b78eee-631a-4518-8dca-62166d674382 response_code = 200 uri = /baseboard
23122024-11-15T21:46:52.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41265
23132024-11-15T21:46:52.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41265 req_id = eba355a7-88de-4eb8-8bfd-fd0de447de13 response_code = 200 uri = /vpc-routes
23142024-11-15T21:46:52.971ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
23152024-11-15T21:46:52.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41265 req_id = 3d42a49f-8cd2-4d31-b90d-c461329d0d31 response_code = 204 uri = /eip-gateways
23162024-11-15T21:46:52.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41265 req_id = 20364592-2057-45fc-9d3d-dfcd660a9995 response_code = 204 uri = /vpc-routes
23172024-11-15T21:46:53.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42959
23182024-11-15T21:46:53.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42959 req_id = 89ee1c94-0d41-4ca2-8331-c799ad296d05 response_code = 200 uri = /vpc-routes
23192024-11-15T21:46:53.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41275
23202024-11-15T21:46:53.018ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23212024-11-15T21:46:53.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23222024-11-15T21:46:53.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41275 req_id = 9177d599-6f08-47bb-8362-b2e60c04f4d6 response_code = 204 uri = /switch-ports
23232024-11-15T21:46:53.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51732
23242024-11-15T21:46:53.157ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
23252024-11-15T21:46:53.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42959 req_id = 0c4e3662-22e5-4528-b08e-239ffb9c2fe6 response_code = 204 uri = /eip-gateways
23262024-11-15T21:46:53.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47722
23272024-11-15T21:46:53.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41275 req_id = 0917d062-81bf-4c0b-8eea-29a5b3bbd678 response_code = 200 uri = /network-bootstore-config
23282024-11-15T21:46:53.157ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23292024-11-15T21:46:53.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51732 req_id = d1480426-084d-42cb-88fc-0d9f56286522 response_code = 200 uri = /v2p
23302024-11-15T21:46:53.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42959 req_id = f8f9e3b4-1695-4406-b32a-2e98c8ab22bf response_code = 204 uri = /vpc-routes
23312024-11-15T21:46:53.197ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23322024-11-15T21:46:53.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55120
23332024-11-15T21:46:53.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55120 req_id = 925ee166-d098-4605-86d2-27c65391a078 response_code = 200 uri = /vpc-routes
23342024-11-15T21:46:53.254ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
23352024-11-15T21:46:53.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55120 req_id = 1c0d98a0-8aa6-4e6c-88c8-dfd98f585586 response_code = 204 uri = /eip-gateways
23362024-11-15T21:46:53.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47722 req_id = 0ea1ce6e-fadc-4620-b2dc-c0c6c3427bb2 response_code = 204 uri = /switch-ports
23372024-11-15T21:46:53.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47722 req_id = d0f52220-fea9-4eaf-b15e-1dd26786f720 response_code = 200 uri = /network-bootstore-config
23382024-11-15T21:46:53.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63040
23392024-11-15T21:46:53.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63040 req_id = b38ee6ce-709d-4ec4-ad8e-1ea4f8368db8 response_code = 200 uri = /v2p
23402024-11-15T21:46:53.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55120 req_id = 6438ef43-8b17-4eac-ad95-77e82eff3b74 response_code = 204 uri = /vpc-routes
23412024-11-15T21:46:53.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64226
23422024-11-15T21:46:53.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64226 req_id = bf7a7e37-9676-45a0-8929-38d86c117c24 response_code = 200 uri = /v2p
23432024-11-15T21:46:53.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61235
23442024-11-15T21:46:53.414ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23452024-11-15T21:46:53.448ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23462024-11-15T21:46:53.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87000 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61235 req_id = a0205317-7e04-4eb7-9e3e-611de6e803aa response_code = 204 uri = /switch-ports
23472024-11-15T21:46:53.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61235 req_id = a02d65de-9319-4975-a720-3a7590ade21f response_code = 200 uri = /network-bootstore-config
23482024-11-15T21:47:05.261ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61976
23492024-11-15T21:47:05.261ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61976 req_id = c7ce3902-cebd-4cb7-bcaf-f0a49b005374 response_code = 200 uri = /baseboard
23502024-11-15T21:47:23.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57974
23512024-11-15T21:47:23.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57974 req_id = cd89f23a-8773-4b66-bbb3-3cb1e0a46643 response_code = 200 uri = /vpc-routes
23522024-11-15T21:47:23.114ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
23532024-11-15T21:47:23.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57974 req_id = 6d07258c-e988-4665-b2ff-f757a8fb0fde response_code = 204 uri = /eip-gateways
23542024-11-15T21:47:23.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57974 req_id = 6296f64e-317b-4b2b-9f9a-369ec92107c9 response_code = 204 uri = /vpc-routes
23552024-11-15T21:47:23.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58265
23562024-11-15T21:47:23.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58265 req_id = 5eb67165-c538-4844-855f-16dec9aebbcb response_code = 200 uri = /vpc-routes
23572024-11-15T21:47:23.241ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
23582024-11-15T21:47:23.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58265 req_id = dcd217b8-308c-440b-9ab6-22775868b775 response_code = 204 uri = /eip-gateways
23592024-11-15T21:47:23.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58265 req_id = 6aed8df5-84d8-428f-8f43-a8fffc22e27e response_code = 204 uri = /vpc-routes
23602024-11-15T21:47:23.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36113
23612024-11-15T21:47:23.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36113 req_id = 04fc2e63-cf0f-45ad-8b61-33a72b047642 response_code = 200 uri = /v2p
23622024-11-15T21:47:23.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44287
23632024-11-15T21:47:23.322ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23642024-11-15T21:47:23.368ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23652024-11-15T21:47:23.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44287 req_id = 01c397a1-bda3-4c51-bd2d-89a3d390ed96 response_code = 204 uri = /switch-ports
23662024-11-15T21:47:23.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34217
23672024-11-15T21:47:23.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59736
23682024-11-15T21:47:23.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36245
23692024-11-15T21:47:23.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44287 req_id = c2aea7af-54bf-4280-b1e8-2aa226fe88b4 response_code = 200 uri = /network-bootstore-config
23702024-11-15T21:47:23.437ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23712024-11-15T21:47:23.437ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23722024-11-15T21:47:23.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23732024-11-15T21:47:23.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36245 req_id = be7facc2-d8f8-47e6-9fde-c97875b26b28 response_code = 200 uri = /v2p
23742024-11-15T21:47:23.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23752024-11-15T21:47:23.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23762024-11-15T21:47:23.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23772024-11-15T21:47:23.442ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23782024-11-15T21:47:23.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23792024-11-15T21:47:23.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5616 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34217 req_id = bddbcb0f-692f-44f8-a1b7-05fc7144e725 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23802024-11-15T21:47:23.475ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23812024-11-15T21:47:23.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94036 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59736 req_id = e090daf9-a3f4-44e0-a84b-6e82ecabf3fd response_code = 204 uri = /switch-ports
23822024-11-15T21:47:23.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59736 req_id = aca3c2d8-cc69-4eb9-865a-dfdba3db729a response_code = 200 uri = /network-bootstore-config
23832024-11-15T21:47:23.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49158
23842024-11-15T21:47:23.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49158 req_id = 067f8252-cfbb-4095-98dd-19f1aa04a8c2 response_code = 200 uri = /vpc-routes
23852024-11-15T21:47:23.586ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
23862024-11-15T21:47:23.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49158 req_id = 004e7aff-52e0-41e9-8cab-7f7c3bc74013 response_code = 204 uri = /eip-gateways
23872024-11-15T21:47:23.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49158 req_id = 8380e632-623a-4b2b-88cf-45bada4afe36 response_code = 204 uri = /vpc-routes
23882024-11-15T21:47:23.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51238
23892024-11-15T21:47:23.597ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23902024-11-15T21:47:23.597ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23912024-11-15T21:47:23.597ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23922024-11-15T21:47:23.597ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23932024-11-15T21:47:23.597ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23942024-11-15T21:47:23.597ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23952024-11-15T21:47:23.597ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23962024-11-15T21:47:23.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51238 req_id = be9f59ef-b268-4b2b-b43a-e32aa5bc4add response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23972024-11-15T21:47:23.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44949
23982024-11-15T21:47:23.638ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23992024-11-15T21:47:23.672ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24002024-11-15T21:47:23.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84236 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44949 req_id = bcc8b4bd-45b7-4736-935b-4cfecdfbc285 response_code = 204 uri = /switch-ports
24012024-11-15T21:47:23.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39762
24022024-11-15T21:47:23.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39762 req_id = 96f6a6b9-5608-4339-9254-cb3f3876f54e response_code = 200 uri = /v2p
24032024-11-15T21:47:23.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44949 req_id = 898a78cf-7c38-4af6-ba6e-d981148bbf3d response_code = 200 uri = /network-bootstore-config
24042024-11-15T21:47:23.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59732
24052024-11-15T21:47:23.837ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24062024-11-15T21:47:23.837ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24072024-11-15T21:47:23.837ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
24082024-11-15T21:47:23.837ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24092024-11-15T21:47:23.837ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24102024-11-15T21:47:23.837ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24112024-11-15T21:47:23.837ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24122024-11-15T21:47:23.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59732 req_id = 3ebf668b-e786-49c6-bd10-92a1cb10ef15 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24132024-11-15T21:47:35.284ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34401
24142024-11-15T21:47:35.284ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34401 req_id = 20c1e651-56a9-49e7-96ab-fc51d6ebc83b response_code = 200 uri = /baseboard
24152024-11-15T21:47:52.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60894
24162024-11-15T21:47:52.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60894 req_id = 6919f809-2ee4-4be7-ba26-a115dab2ae97 response_code = 200 uri = /vpc-routes
24172024-11-15T21:47:52.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47501
24182024-11-15T21:47:52.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47501 req_id = 412ea9b4-043d-4771-ad70-af9e920b130a response_code = 200 uri = /v2p
24192024-11-15T21:47:52.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60479
24202024-11-15T21:47:52.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60479 req_id = 9173e984-c7bb-4093-a039-c98ec437edd5 response_code = 200 uri = /v2p
24212024-11-15T21:47:52.989ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
24222024-11-15T21:47:52.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60894 req_id = d6247260-4086-4be6-8dbb-5721f02f7b34 response_code = 204 uri = /eip-gateways
24232024-11-15T21:47:52.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60894 req_id = ccebd84d-34fd-465b-b6c7-d1deea793ba0 response_code = 204 uri = /vpc-routes
24242024-11-15T21:47:53.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37111
24252024-11-15T21:47:53.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37111 req_id = e7081218-cd41-446a-a98d-2230d23be777 response_code = 200 uri = /vpc-routes
24262024-11-15T21:47:53.037ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
24272024-11-15T21:47:53.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37111 req_id = bad26822-1452-4f00-8c5e-8f7e43be8d8b response_code = 204 uri = /eip-gateways
24282024-11-15T21:47:53.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37111 req_id = ec3f1553-ae71-43dd-903d-3347b6718e55 response_code = 204 uri = /vpc-routes
24292024-11-15T21:47:53.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64823
24302024-11-15T21:47:53.081ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24312024-11-15T21:47:53.126ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24322024-11-15T21:47:53.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101299 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64823 req_id = d1eb2fda-5f73-454a-99dd-c2aa5ee069d4 response_code = 204 uri = /switch-ports
24332024-11-15T21:47:53.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41231
24342024-11-15T21:47:53.183ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24352024-11-15T21:47:53.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64823 req_id = 76a6c6b3-2273-4282-b284-be4b972c0c9f response_code = 200 uri = /network-bootstore-config
24362024-11-15T21:47:53.224ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24372024-11-15T21:47:53.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38543
24382024-11-15T21:47:53.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38543 req_id = ca7995d8-97ed-40f8-b94c-249001785a73 response_code = 200 uri = /vpc-routes
24392024-11-15T21:47:53.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99629 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41231 req_id = 221470c4-5095-486a-a2dc-7b47164a0f4f response_code = 204 uri = /switch-ports
24402024-11-15T21:47:53.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41231 req_id = b123f64b-fdc3-4d9a-9949-60552830305d response_code = 200 uri = /network-bootstore-config
24412024-11-15T21:47:53.317ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
24422024-11-15T21:47:53.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38543 req_id = bd437979-d4ef-456b-8030-cb8ed8e52617 response_code = 204 uri = /eip-gateways
24432024-11-15T21:47:53.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38543 req_id = 45659bbd-86cc-4b19-ab79-24ff337f68dd response_code = 204 uri = /vpc-routes
24442024-11-15T21:47:53.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50574
24452024-11-15T21:47:53.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50574 req_id = e8ee43af-6fb8-4899-94f6-e2b2ed923af3 response_code = 200 uri = /v2p
24462024-11-15T21:47:53.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51319
24472024-11-15T21:47:53.509ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24482024-11-15T21:47:53.549ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24492024-11-15T21:47:53.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96122 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51319 req_id = 7923fc16-a751-41f9-96d0-f67562d35b3e response_code = 204 uri = /switch-ports
24502024-11-15T21:47:53.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51319 req_id = 48a9b16c-b40d-4ea3-88c8-d6afbeb458cd response_code = 200 uri = /network-bootstore-config
24512024-11-15T21:48:05.324ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57344
24522024-11-15T21:48:05.324ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57344 req_id = 271e532d-646e-42d7-bbcf-f5189891c452 response_code = 200 uri = /baseboard
24532024-11-15T21:48:06.064ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24542024-11-15T21:48:06.064ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24552024-11-15T21:48:06.098ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1968, tv_nsec: 57442128 } time_to_next_cleanup = 599.99999575s
24562024-11-15T21:48:20.604ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24572024-11-15T21:48:23.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59592
24582024-11-15T21:48:23.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59592 req_id = b6bf2dd4-aeb4-4034-877e-8d98c7ec1165 response_code = 200 uri = /vpc-routes
24592024-11-15T21:48:23.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58897
24602024-11-15T21:48:23.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58897 req_id = 7f87cdf9-a0df-45b6-883f-a1ff9618f3bb response_code = 200 uri = /vpc-routes
24612024-11-15T21:48:23.174ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
24622024-11-15T21:48:23.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58897 req_id = f0fa9bc7-137c-4e02-b959-ae321b9b3a34 response_code = 204 uri = /eip-gateways
24632024-11-15T21:48:23.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58897 req_id = ed44ee30-d085-4a39-8697-fc29ba0f4032 response_code = 204 uri = /vpc-routes
24642024-11-15T21:48:23.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
24652024-11-15T21:48:23.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59592 req_id = 6fcd7b5c-0232-4ac9-83ce-9072f200e528 response_code = 204 uri = /eip-gateways
24662024-11-15T21:48:23.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59592 req_id = b67d11b2-bb29-4f5e-98ae-2a90018cae52 response_code = 204 uri = /vpc-routes
24672024-11-15T21:48:23.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59208
24682024-11-15T21:48:23.278ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24692024-11-15T21:48:23.320ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24702024-11-15T21:48:23.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101488 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59208 req_id = eb7e9dbf-1ea3-4c86-9e7b-8e2895f9d2a3 response_code = 204 uri = /switch-ports
24712024-11-15T21:48:23.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65437
24722024-11-15T21:48:23.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50139
24732024-11-15T21:48:23.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59208 req_id = 359d7dd2-a157-421a-acbc-952c164bbd54 response_code = 200 uri = /network-bootstore-config
24742024-11-15T21:48:23.380ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24752024-11-15T21:48:23.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50139 req_id = 95d0c876-ce92-49be-8bbb-60ca4c93ec32 response_code = 200 uri = /v2p
24762024-11-15T21:48:23.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42403
24772024-11-15T21:48:23.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42403 req_id = 797c72cb-bbe2-4a93-8ed1-ea6db1a2fd2a response_code = 200 uri = /vpc-routes
24782024-11-15T21:48:23.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62732
24792024-11-15T21:48:23.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62732 req_id = a606fd34-1b9b-410d-bdfa-d61412aa1b4d response_code = 200 uri = /v2p
24802024-11-15T21:48:23.423ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24812024-11-15T21:48:23.447ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
24822024-11-15T21:48:23.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42403 req_id = 575a97b1-11e6-4e92-86b3-6213e9bb9e26 response_code = 204 uri = /eip-gateways
24832024-11-15T21:48:23.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42403 req_id = d1a80202-fe7e-405a-87bc-3e090a22ab04 response_code = 204 uri = /vpc-routes
24842024-11-15T21:48:23.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110604 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65437 req_id = 0fa625a4-e2b1-4eaf-b826-d237cb070c2c response_code = 204 uri = /switch-ports
24852024-11-15T21:48:23.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65437 req_id = 9ef9b3a7-b958-4f8e-86b1-6c443766c6ac response_code = 200 uri = /network-bootstore-config
24862024-11-15T21:48:23.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43462
24872024-11-15T21:48:23.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43462 req_id = 10451328-f9ac-4dc6-8975-8cfcb21ada6b response_code = 200 uri = /v2p
24882024-11-15T21:48:23.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43651
24892024-11-15T21:48:23.720ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24902024-11-15T21:48:23.758ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24912024-11-15T21:48:23.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96158 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43651 req_id = c914099f-62a0-460c-b1d2-9de8d9003403 response_code = 204 uri = /switch-ports
24922024-11-15T21:48:23.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43651 req_id = 67d94e54-f9c8-4bd3-b744-0e552ece9f41 response_code = 200 uri = /network-bootstore-config
24932024-11-15T21:48:35.365ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45954
24942024-11-15T21:48:35.366ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45954 req_id = 62f7273d-0468-4498-a598-35fa0683a788 response_code = 200 uri = /baseboard
24952024-11-15T21:48:52.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44716
24962024-11-15T21:48:52.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44716 req_id = 1876b446-18bc-414b-8cce-e78a70c79403 response_code = 200 uri = /vpc-routes
24972024-11-15T21:48:53.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46196
24982024-11-15T21:48:53.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46196 req_id = 4cd4a6fd-cba0-4c83-982e-1dedd1f80de4 response_code = 200 uri = /vpc-routes
24992024-11-15T21:48:53.047ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
25002024-11-15T21:48:53.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44716 req_id = 847378e5-894c-432c-a163-4bb232257b50 response_code = 204 uri = /eip-gateways
25012024-11-15T21:48:53.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44716 req_id = 06048537-4d45-4936-98dc-60c660b637ab response_code = 204 uri = /vpc-routes
25022024-11-15T21:48:53.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
25032024-11-15T21:48:53.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46196 req_id = 1c461fb0-a645-45ba-ab37-492fa4d46a41 response_code = 204 uri = /eip-gateways
25042024-11-15T21:48:53.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46196 req_id = 253e9492-064e-49dc-b100-b23e979785ae response_code = 204 uri = /vpc-routes
25052024-11-15T21:48:53.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52947
25062024-11-15T21:48:53.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52947 req_id = 909935af-8729-4b2b-96d6-0835d7eeb688 response_code = 200 uri = /v2p
25072024-11-15T21:48:53.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37053
25082024-11-15T21:48:53.141ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25092024-11-15T21:48:53.189ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25102024-11-15T21:48:53.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113860 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37053 req_id = f5c62edc-492d-42e2-ae89-8293ba7ec39d response_code = 204 uri = /switch-ports
25112024-11-15T21:48:53.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53152
25122024-11-15T21:48:53.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35144
25132024-11-15T21:48:53.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61419
25142024-11-15T21:48:53.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61419 req_id = ebd0f17b-7e17-412b-a2dc-835d39b7c9ef response_code = 200 uri = /vpc-routes
25152024-11-15T21:48:53.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37053 req_id = 4a7cc25f-2b0a-4662-8b6b-d7412b94b0c6 response_code = 200 uri = /network-bootstore-config
25162024-11-15T21:48:53.256ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25172024-11-15T21:48:53.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5779 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35144 req_id = 70458446-7d46-457e-8380-fe841434e8b9 response_code = 200 uri = /v2p
25182024-11-15T21:48:53.297ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25192024-11-15T21:48:53.301ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
25202024-11-15T21:48:53.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 657 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61419 req_id = b3fced05-53ba-4774-be17-397a15cfe1e1 response_code = 204 uri = /eip-gateways
25212024-11-15T21:48:53.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48967
25222024-11-15T21:48:53.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48967 req_id = 49fffe20-5561-4a6c-88bc-1b0c1bbd003e response_code = 200 uri = /v2p
25232024-11-15T21:48:53.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 951 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61419 req_id = 8fec5bb7-4a3a-4869-9ac3-e875d38d71a7 response_code = 204 uri = /vpc-routes
25242024-11-15T21:48:53.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49406
25252024-11-15T21:48:53.356ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25262024-11-15T21:48:53.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100660 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53152 req_id = ddb4513e-bc05-44d6-875f-d77dc3a4b459 response_code = 204 uri = /switch-ports
25272024-11-15T21:48:53.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 741 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53152 req_id = 512bf628-270a-4822-a0ff-f92fe93351b8 response_code = 200 uri = /network-bootstore-config
25282024-11-15T21:48:53.396ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25292024-11-15T21:48:53.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108173 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49406 req_id = e944a0be-0915-4ddb-8a41-0f560753bf8a response_code = 204 uri = /switch-ports
25302024-11-15T21:48:53.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49406 req_id = a8dbfddb-d60c-4355-8f4e-71a411db7a54 response_code = 200 uri = /network-bootstore-config
25312024-11-15T21:49:05.396ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54049
25322024-11-15T21:49:05.397ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54049 req_id = a25c409c-a284-49c8-9907-92f3c8bc294a response_code = 200 uri = /baseboard
25332024-11-15T21:49:23.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43890
25342024-11-15T21:49:23.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43890 req_id = 5e7cf726-52f5-485b-98e4-ee7b7f8584bd response_code = 200 uri = /vpc-routes
25352024-11-15T21:49:23.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56622
25362024-11-15T21:49:23.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56622 req_id = f3cf76e7-735e-43c7-93f5-d64217e3e0b7 response_code = 200 uri = /vpc-routes
25372024-11-15T21:49:23.100ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
25382024-11-15T21:49:23.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43890 req_id = 4e2d1c4e-cd3c-4036-8aae-54c9a98bab4a response_code = 204 uri = /eip-gateways
25392024-11-15T21:49:23.102ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
25402024-11-15T21:49:23.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56622 req_id = 821e3882-9a61-47f0-a730-ce28d4c29d0f response_code = 204 uri = /eip-gateways
25412024-11-15T21:49:23.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43890 req_id = ce2ca3c4-d755-4a41-9b79-7ce1066dd26a response_code = 204 uri = /vpc-routes
25422024-11-15T21:49:23.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56622 req_id = 93a16cd3-4071-4f1b-b744-55a24b2d1fc9 response_code = 204 uri = /vpc-routes
25432024-11-15T21:49:23.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45428
25442024-11-15T21:49:23.269ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25452024-11-15T21:49:23.312ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25462024-11-15T21:49:23.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101104 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45428 req_id = 3a660ffc-4e45-4b22-b4d7-e6fe3c1d4aae response_code = 204 uri = /switch-ports
25472024-11-15T21:49:23.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40662
25482024-11-15T21:49:23.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34782
25492024-11-15T21:49:23.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47786
25502024-11-15T21:49:23.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64039
25512024-11-15T21:49:23.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64039 req_id = 175f0593-e87d-4f38-84e2-c225c7238a84 response_code = 200 uri = /vpc-routes
25522024-11-15T21:49:23.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34782 req_id = 34a22361-da56-48a2-b1b9-166ea225e9e2 response_code = 200 uri = /v2p
25532024-11-15T21:49:23.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45428 req_id = fde74c11-caec-4aac-888e-a40df6d3378b response_code = 200 uri = /network-bootstore-config
25542024-11-15T21:49:23.371ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25552024-11-15T21:49:23.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40662 req_id = 4f009046-b9db-4105-a2ae-95e2dc84417d response_code = 200 uri = /v2p
25562024-11-15T21:49:23.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36863
25572024-11-15T21:49:23.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36863 req_id = 19ded566-cc76-4610-b711-ab07fa308588 response_code = 200 uri = /v2p
25582024-11-15T21:49:23.409ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25592024-11-15T21:49:23.452ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
25602024-11-15T21:49:23.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 711 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64039 req_id = 0ea916aa-8c70-4b47-84a8-53804e927dd5 response_code = 204 uri = /eip-gateways
25612024-11-15T21:49:23.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 879 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64039 req_id = dbc3a4ac-794c-4a56-ae0b-ebebe77a3bb9 response_code = 204 uri = /vpc-routes
25622024-11-15T21:49:23.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103428 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47786 req_id = c29ff847-7469-4d42-be1d-648b2d7b0172 response_code = 204 uri = /switch-ports
25632024-11-15T21:49:23.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47786 req_id = 093bb3a3-a6c2-47d4-beb7-0fe5d352bf8f response_code = 200 uri = /network-bootstore-config
25642024-11-15T21:49:23.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34972
25652024-11-15T21:49:23.634ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25662024-11-15T21:49:23.676ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25672024-11-15T21:49:23.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101470 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34972 req_id = 573aa9b1-d77b-4ed0-9494-66a5e7b5648d response_code = 204 uri = /switch-ports
25682024-11-15T21:49:23.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34972 req_id = 6a35ce68-5dd6-4fe7-a2fe-23e5a65c79ce response_code = 200 uri = /network-bootstore-config
25692024-11-15T21:49:35.434ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32967
25702024-11-15T21:49:35.434ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32967 req_id = 1ac92969-1825-4d3c-a501-db5a8ef43c58 response_code = 200 uri = /baseboard
25712024-11-15T21:49:45.761ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
25722024-11-15T21:49:45.762ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
25732024-11-15T21:49:53.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43466
25742024-11-15T21:49:53.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43466 req_id = 1585a1c4-62aa-44b3-93bd-a6346cc1516d response_code = 200 uri = /vpc-routes
25752024-11-15T21:49:53.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61498
25762024-11-15T21:49:53.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61498 req_id = 1050f8eb-aad3-4279-9fc3-162198b8830c response_code = 200 uri = /vpc-routes
25772024-11-15T21:49:53.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
25782024-11-15T21:49:53.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43466 req_id = 8987caaf-5432-4c9a-adfa-c8aa89dcb8f1 response_code = 204 uri = /eip-gateways
25792024-11-15T21:49:53.086ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
25802024-11-15T21:49:53.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61498 req_id = 2b45db87-4607-487f-ad01-247526834322 response_code = 204 uri = /eip-gateways
25812024-11-15T21:49:53.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50338
25822024-11-15T21:49:53.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50338 req_id = 1c189e63-001b-40f8-991a-0ccba9aa0c2c response_code = 200 uri = /v2p
25832024-11-15T21:49:53.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43466 req_id = df657b1a-d055-4644-8540-b624e8f32358 response_code = 204 uri = /vpc-routes
25842024-11-15T21:49:53.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59772
25852024-11-15T21:49:53.120ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25862024-11-15T21:49:53.163ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25872024-11-15T21:49:53.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102960 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59772 req_id = 486d5d1e-1b8b-4c8a-8e51-8d65a413a561 response_code = 204 uri = /switch-ports
25882024-11-15T21:49:53.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35507
25892024-11-15T21:49:53.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61498 req_id = 4476b168-30e8-4a7e-a8c6-1f17dde58c0a response_code = 204 uri = /vpc-routes
25902024-11-15T21:49:53.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59772 req_id = cfc7f084-a55c-4973-abbc-d6ffa31b99f3 response_code = 200 uri = /network-bootstore-config
25912024-11-15T21:49:53.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 998 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35507 req_id = 3548798a-e3ee-4e83-89e2-3408e1fd9e33 response_code = 200 uri = /v2p
25922024-11-15T21:49:53.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39784
25932024-11-15T21:49:53.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39784 req_id = f9800a55-d3c9-405d-ab1c-d989942a3477 response_code = 200 uri = /vpc-routes
25942024-11-15T21:49:53.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47938
25952024-11-15T21:49:53.279ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25962024-11-15T21:49:53.325ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25972024-11-15T21:49:53.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107761 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47938 req_id = 0d786ea9-2fb4-4190-9c7b-907ae0a4f308 response_code = 204 uri = /switch-ports
25982024-11-15T21:49:53.386ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
25992024-11-15T21:49:53.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39784 req_id = f7319e93-4469-47b2-813f-f3ab8945b609 response_code = 204 uri = /eip-gateways
26002024-11-15T21:49:53.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47938 req_id = 71f6b7c3-df08-4369-8896-53572e7438f8 response_code = 200 uri = /network-bootstore-config
26012024-11-15T21:49:53.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52248
26022024-11-15T21:49:53.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52248 req_id = 4df9387c-7c71-41e1-826d-d83a8b873e5f response_code = 200 uri = /v2p
26032024-11-15T21:49:53.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39784 req_id = 152f3f84-8aec-475f-92a1-bbf450ad0181 response_code = 204 uri = /vpc-routes
26042024-11-15T21:49:53.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54219
26052024-11-15T21:49:53.439ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26062024-11-15T21:49:53.480ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26072024-11-15T21:49:53.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98572 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54219 req_id = 56057015-256e-46f7-b9e5-8a24d951ff93 response_code = 204 uri = /switch-ports
26082024-11-15T21:49:53.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54219 req_id = f3f1f05b-26c7-4e7d-8e00-f667e7ab875a response_code = 200 uri = /network-bootstore-config
26092024-11-15T21:49:55.761ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26102024-11-15T21:49:55.762ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26112024-11-15T21:49:55.764ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26122024-11-15T21:49:55.765ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26132024-11-15T21:50:05.463ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53869
26142024-11-15T21:50:05.463ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53869 req_id = 39ee13de-8bc8-4663-b4fe-4f441d38b5fe response_code = 200 uri = /baseboard
26152024-11-15T21:50:05.762ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26162024-11-15T21:50:05.763ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26172024-11-15T21:50:05.766ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26182024-11-15T21:50:05.766ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26192024-11-15T21:50:15.772ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26202024-11-15T21:50:15.772ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26212024-11-15T21:50:15.775ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26222024-11-15T21:50:15.776ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26232024-11-15T21:50:22.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45471
26242024-11-15T21:50:22.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45471 req_id = 4498173d-fe51-4caf-a921-7c3abcf79cd0 response_code = 200 uri = /vpc-routes
26252024-11-15T21:50:22.969ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
26262024-11-15T21:50:22.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45471 req_id = 6157b71e-e3f9-462b-9208-7fa7a6f6167c response_code = 204 uri = /eip-gateways
26272024-11-15T21:50:22.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45471 req_id = 963a7eb1-213a-4dce-9126-2a4be5758cef response_code = 204 uri = /vpc-routes
26282024-11-15T21:50:23.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41278
26292024-11-15T21:50:23.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41278 req_id = f86209de-8245-43a3-a1c7-cd410b850314 response_code = 200 uri = /v2p
26302024-11-15T21:50:23.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60000
26312024-11-15T21:50:23.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60000 req_id = aca254cd-4128-4ed3-b2ea-a7a5c8cdd2bf response_code = 200 uri = /v2p
26322024-11-15T21:50:23.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53142
26332024-11-15T21:50:23.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53142 req_id = e24f1e47-2518-4780-a513-45d7037793f7 response_code = 200 uri = /vpc-routes
26342024-11-15T21:50:23.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63646
26352024-11-15T21:50:23.274ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26362024-11-15T21:50:23.319ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26372024-11-15T21:50:23.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63646 req_id = 2b771315-384f-45f5-b0fe-40c8a5feb3ca response_code = 204 uri = /switch-ports
26382024-11-15T21:50:23.383ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
26392024-11-15T21:50:23.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53142 req_id = 2028e160-4f38-4af0-a16d-b72b577dbcc1 response_code = 204 uri = /eip-gateways
26402024-11-15T21:50:23.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63646 req_id = 19e8a5cf-ed7a-482a-845e-f05577db7f36 response_code = 200 uri = /network-bootstore-config
26412024-11-15T21:50:23.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53142 req_id = b5ae4cfc-cbe6-4bdd-9af0-7cef0311c437 response_code = 204 uri = /vpc-routes
26422024-11-15T21:50:23.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64476
26432024-11-15T21:50:23.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64476 req_id = b4090499-0288-4eba-be80-232f54970fee response_code = 200 uri = /vpc-routes
26442024-11-15T21:50:23.465ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
26452024-11-15T21:50:23.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64476 req_id = 009c4112-c5e3-4347-8435-17eb60aa6700 response_code = 204 uri = /eip-gateways
26462024-11-15T21:50:23.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59714
26472024-11-15T21:50:23.555ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26482024-11-15T21:50:23.595ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26492024-11-15T21:50:23.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100692 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59714 req_id = e2df365f-2aba-4c3b-92cf-a5766a1191f9 response_code = 204 uri = /switch-ports
26502024-11-15T21:50:23.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45292
26512024-11-15T21:50:23.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59511
26522024-11-15T21:50:23.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59714 req_id = 4ba8c809-4285-431f-92a0-0d8ccbf7520a response_code = 200 uri = /network-bootstore-config
26532024-11-15T21:50:23.656ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26542024-11-15T21:50:23.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 598 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45292 req_id = 2c114ae2-dae9-455f-adab-a5b48825ebc3 response_code = 200 uri = /v2p
26552024-11-15T21:50:23.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8657 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64476 req_id = a20e07ca-9434-4de9-b2f6-d20c5fe85fe2 response_code = 204 uri = /vpc-routes
26562024-11-15T21:50:23.695ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26572024-11-15T21:50:23.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94467 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59511 req_id = 6dd1440b-675e-4d67-8dee-9a12d558f570 response_code = 204 uri = /switch-ports
26582024-11-15T21:50:23.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59511 req_id = 069b03eb-fb9b-4abd-aab9-99ec6b5ebb51 response_code = 200 uri = /network-bootstore-config
26592024-11-15T21:50:25.780ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26602024-11-15T21:50:25.781ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26612024-11-15T21:50:25.783ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26622024-11-15T21:50:25.784ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26632024-11-15T21:50:35.506ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57744
26642024-11-15T21:50:35.506ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57744 req_id = 3682abe2-a161-4b5c-925e-3afc0913a0f2 response_code = 200 uri = /baseboard
26652024-11-15T21:50:35.783ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26662024-11-15T21:50:35.784ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26672024-11-15T21:50:35.786ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26682024-11-15T21:50:35.787ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26692024-11-15T21:50:45.785ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26702024-11-15T21:50:45.786ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26712024-11-15T21:50:45.788ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26722024-11-15T21:50:45.789ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
26732024-11-15T21:50:52.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35400
26742024-11-15T21:50:52.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35400 req_id = e1f4d805-4fec-4453-8444-b1eb2d3c237e response_code = 200 uri = /vpc-routes
26752024-11-15T21:50:52.930ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
26762024-11-15T21:50:52.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35400 req_id = 0de8ccfd-3015-4ca2-b391-b298bc9f0235 response_code = 204 uri = /eip-gateways
26772024-11-15T21:50:52.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35400 req_id = ccd28f81-76a9-4c0b-8af2-9464a520984d response_code = 204 uri = /vpc-routes
26782024-11-15T21:50:53.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37833
26792024-11-15T21:50:53.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37833 req_id = 0807bc07-d7cb-463a-97a8-21d5f1908644 response_code = 200 uri = /v2p
26802024-11-15T21:50:53.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41812
26812024-11-15T21:50:53.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41812 req_id = 84e109e4-ea01-45e1-b78c-5bf68cda3262 response_code = 200 uri = /vpc-routes
26822024-11-15T21:50:53.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60450
26832024-11-15T21:50:53.082ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26842024-11-15T21:50:53.132ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26852024-11-15T21:50:53.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127917 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60450 req_id = f972b927-3fef-4a95-9347-8310543233ff response_code = 204 uri = /switch-ports
26862024-11-15T21:50:53.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44665
26872024-11-15T21:50:53.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60450 req_id = a73d4f3d-6c57-47a8-be4c-eed8f29fb432 response_code = 200 uri = /network-bootstore-config
26882024-11-15T21:50:53.210ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
26892024-11-15T21:50:53.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41812 req_id = 671dd9ae-ade6-44ff-b726-229cb3f1b128 response_code = 204 uri = /eip-gateways
26902024-11-15T21:50:53.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44665 req_id = 8e2114a6-63d1-4027-ba83-a13a7eb066bd response_code = 200 uri = /v2p
26912024-11-15T21:50:53.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41812 req_id = 7e056edf-638c-498f-8142-64bbe915ef09 response_code = 204 uri = /vpc-routes
26922024-11-15T21:50:53.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65145
26932024-11-15T21:50:53.229ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26942024-11-15T21:50:53.269ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26952024-11-15T21:50:53.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65145 req_id = b21c4620-3392-4be7-bd9e-9a178bf8e7e8 response_code = 204 uri = /switch-ports
26962024-11-15T21:50:53.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61479
26972024-11-15T21:50:53.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61479 req_id = 92a37cdd-c990-4320-8982-a3fc973136fa response_code = 200 uri = /vpc-routes
26982024-11-15T21:50:53.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65145 req_id = 0ce60b53-3687-4191-a329-9dc03e044b0c response_code = 200 uri = /network-bootstore-config
26992024-11-15T21:50:53.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45503
27002024-11-15T21:50:53.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45503 req_id = 5660099b-6a76-49aa-9271-e0dc65dd2090 response_code = 200 uri = /v2p
27012024-11-15T21:50:53.417ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
27022024-11-15T21:50:53.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61479 req_id = 0771cbdf-2edf-439a-902e-7b468806b1ca response_code = 204 uri = /eip-gateways
27032024-11-15T21:50:53.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61479 req_id = ab220a86-26e8-44ee-9650-b49bd4887838 response_code = 204 uri = /vpc-routes
27042024-11-15T21:50:53.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42687
27052024-11-15T21:50:53.618ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27062024-11-15T21:50:53.659ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27072024-11-15T21:50:53.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98533 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42687 req_id = 1ee81bb7-b8e6-46b8-b578-d19c5b9529bd response_code = 204 uri = /switch-ports
27082024-11-15T21:50:53.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42687 req_id = 084aadf0-d353-4840-9fe0-c7ce7b34e578 response_code = 200 uri = /network-bootstore-config
27092024-11-15T21:50:55.787ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27102024-11-15T21:50:55.788ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27112024-11-15T21:50:55.790ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27122024-11-15T21:50:55.791ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27132024-11-15T21:51:05.538ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40968
27142024-11-15T21:51:05.538ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40968 req_id = cdb2bbb7-db18-4ae6-96de-2498bc7dc970 response_code = 200 uri = /baseboard
27152024-11-15T21:51:05.791ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27162024-11-15T21:51:05.791ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27172024-11-15T21:51:05.794ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27182024-11-15T21:51:05.794ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27192024-11-15T21:51:15.794ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27202024-11-15T21:51:15.795ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27212024-11-15T21:51:15.797ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27222024-11-15T21:51:15.798ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27232024-11-15T21:51:23.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48753
27242024-11-15T21:51:23.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48753 req_id = 9a3a704f-44b6-42a4-81d9-3c2ed536d11c response_code = 200 uri = /vpc-routes
27252024-11-15T21:51:23.157ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
27262024-11-15T21:51:23.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48753 req_id = 79fbb3ff-25b4-4c22-bb34-ec7fa144a75c response_code = 204 uri = /eip-gateways
27272024-11-15T21:51:23.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48753 req_id = 4fc77de3-af44-4ea3-b6a4-79fe3bae1c22 response_code = 204 uri = /vpc-routes
27282024-11-15T21:51:23.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53526
27292024-11-15T21:51:23.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53526 req_id = 45e98e42-e350-4c61-87a8-7bcaa4de8f86 response_code = 200 uri = /vpc-routes
27302024-11-15T21:51:23.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38914
27312024-11-15T21:51:23.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38914 req_id = 567cb00d-0fec-4873-ac70-c4353bc7d4e8 response_code = 200 uri = /vpc-routes
27322024-11-15T21:51:23.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37830
27332024-11-15T21:51:23.352ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27342024-11-15T21:51:23.402ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27352024-11-15T21:51:23.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127222 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37830 req_id = 2c685748-7913-440f-ab61-df4be7ee7d0a response_code = 204 uri = /switch-ports
27362024-11-15T21:51:23.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42984
27372024-11-15T21:51:23.480ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
27382024-11-15T21:51:23.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38914 req_id = 19a3bdf9-5cd1-49a8-b106-c08bf88c4168 response_code = 204 uri = /eip-gateways
27392024-11-15T21:51:23.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53393
27402024-11-15T21:51:23.480ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
27412024-11-15T21:51:23.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53526 req_id = ba9a0e49-766a-4675-8104-8a940e4bd140 response_code = 204 uri = /eip-gateways
27422024-11-15T21:51:23.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37830 req_id = 2688bcca-3b61-48d8-8b7e-277d673ab131 response_code = 200 uri = /network-bootstore-config
27432024-11-15T21:51:23.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42984 req_id = be8c9e92-b57a-449c-9a80-49f132f4e290 response_code = 200 uri = /v2p
27442024-11-15T21:51:23.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53393 req_id = c5a64c2e-5d7b-4a05-b5c1-d51f2a43b83d response_code = 200 uri = /v2p
27452024-11-15T21:51:23.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38914 req_id = 3a60fa4b-d04a-4586-956f-ef5ae9dae247 response_code = 204 uri = /vpc-routes
27462024-11-15T21:51:23.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47613
27472024-11-15T21:51:23.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47613 req_id = 1c2a38ec-ba73-41bb-a7d3-811a5c9338c2 response_code = 200 uri = /v2p
27482024-11-15T21:51:23.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53526 req_id = d4350ac3-3a46-4b34-9837-e80a5ec3ff10 response_code = 204 uri = /vpc-routes
27492024-11-15T21:51:23.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56265
27502024-11-15T21:51:23.605ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27512024-11-15T21:51:23.641ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27522024-11-15T21:51:23.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98675 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56265 req_id = a2e202ae-0d97-4b0a-a3c8-9b4699078592 response_code = 204 uri = /switch-ports
27532024-11-15T21:51:23.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56265 req_id = 59da5bd8-2134-4803-ae9c-f0188c8d57c8 response_code = 200 uri = /network-bootstore-config
27542024-11-15T21:51:23.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51686
27552024-11-15T21:51:23.714ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27562024-11-15T21:51:23.757ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27572024-11-15T21:51:23.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108768 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51686 req_id = d9a472d9-0b5b-467b-bde1-292da75f9a0d response_code = 204 uri = /switch-ports
27582024-11-15T21:51:23.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51686 req_id = 8fe55e05-7eba-4e13-b671-208d3065e0c9 response_code = 200 uri = /network-bootstore-config
27592024-11-15T21:51:25.800ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27602024-11-15T21:51:25.801ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27612024-11-15T21:51:25.803ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27622024-11-15T21:51:25.804ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27632024-11-15T21:51:35.576ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37388
27642024-11-15T21:51:35.576ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37388 req_id = e7b84d44-b5e6-4de7-ba81-f4f02ab6a04b response_code = 200 uri = /baseboard
27652024-11-15T21:51:35.804ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27662024-11-15T21:51:35.804ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27672024-11-15T21:51:35.807ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27682024-11-15T21:51:35.807ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27692024-11-15T21:51:45.805ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27702024-11-15T21:51:45.805ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27712024-11-15T21:51:45.808ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27722024-11-15T21:51:45.808ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
27732024-11-15T21:51:52.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33674
27742024-11-15T21:51:52.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33674 req_id = eea7a3e1-b012-47bd-8e39-53dd5cf92c39 response_code = 200 uri = /vpc-routes
27752024-11-15T21:51:52.993ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
27762024-11-15T21:51:52.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33674 req_id = 64199d17-6709-4b55-ace3-9fd3e4dd923e response_code = 204 uri = /eip-gateways
27772024-11-15T21:51:53.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33674 req_id = 6416295e-b494-4d03-ac61-5ff7a12752f1 response_code = 204 uri = /vpc-routes
27782024-11-15T21:51:53.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59074
27792024-11-15T21:51:53.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59074 req_id = e092fe55-fa3e-4348-b2c0-27b67bdab76d response_code = 200 uri = /v2p
27802024-11-15T21:51:53.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57485
27812024-11-15T21:51:53.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57485 req_id = 08d5b991-5240-4990-8fac-12a02bf70c84 response_code = 200 uri = /vpc-routes
27822024-11-15T21:51:53.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52966
27832024-11-15T21:51:53.069ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27842024-11-15T21:51:53.124ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27852024-11-15T21:51:53.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120151 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52966 req_id = 4b388451-89b1-4046-bcc3-81213951d1d5 response_code = 204 uri = /switch-ports
27862024-11-15T21:51:53.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61843
27872024-11-15T21:51:53.190ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
27882024-11-15T21:51:53.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57485 req_id = e02957f6-7a1a-46a3-89ef-141c2f14291a response_code = 204 uri = /eip-gateways
27892024-11-15T21:51:53.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46953
27902024-11-15T21:51:53.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52966 req_id = 2a6265c4-4285-451b-a02c-fef38800d921 response_code = 200 uri = /network-bootstore-config
27912024-11-15T21:51:53.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27922024-11-15T21:51:53.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4882 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46953 req_id = 2a940988-f2ac-4aaf-b0b0-aba1bd4b7ca7 response_code = 200 uri = /v2p
27932024-11-15T21:51:53.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57485 req_id = 8d5e2061-e341-4f15-83c0-a9cd13fdbb74 response_code = 204 uri = /vpc-routes
27942024-11-15T21:51:53.234ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27952024-11-15T21:51:53.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45687
27962024-11-15T21:51:53.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45687 req_id = 0126b975-ccbd-4d66-af38-66e4178ac4a2 response_code = 200 uri = /vpc-routes
27972024-11-15T21:51:53.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50221
27982024-11-15T21:51:53.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50221 req_id = fe0de066-1fe6-402c-8a77-94bf54eaa00f response_code = 200 uri = /v2p
27992024-11-15T21:51:53.272ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
28002024-11-15T21:51:53.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45687 req_id = fa159b7b-c79d-4b38-a755-5b84cddc26d2 response_code = 204 uri = /eip-gateways
28012024-11-15T21:51:53.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 848 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45687 req_id = e1a5c84c-9345-4942-bb13-cbbaf7bc6745 response_code = 204 uri = /vpc-routes
28022024-11-15T21:51:53.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102292 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61843 req_id = ebad658d-0b4d-4ddc-8d73-5cc278d4af7e response_code = 204 uri = /switch-ports
28032024-11-15T21:51:53.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61843 req_id = f6bd0366-e706-4b4c-8e56-d6fb68394f89 response_code = 200 uri = /network-bootstore-config
28042024-11-15T21:51:53.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35956
28052024-11-15T21:51:53.342ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28062024-11-15T21:51:53.378ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28072024-11-15T21:51:53.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93064 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35956 req_id = 7fc2ddaf-f760-468c-94a2-96b76e107d97 response_code = 204 uri = /switch-ports
28082024-11-15T21:51:53.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35956 req_id = c5c7973d-fc62-48cd-a96f-e80720dd94e5 response_code = 200 uri = /network-bootstore-config
28092024-11-15T21:51:55.809ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28102024-11-15T21:51:55.810ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28112024-11-15T21:51:55.812ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28122024-11-15T21:51:55.813ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28132024-11-15T21:52:05.609ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49272
28142024-11-15T21:52:05.609ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49272 req_id = e71648d6-861a-4d46-bc47-9b2634113755 response_code = 200 uri = /baseboard
28152024-11-15T21:52:05.813ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28162024-11-15T21:52:05.813ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28172024-11-15T21:52:05.816ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28182024-11-15T21:52:05.816ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28192024-11-15T21:52:15.816ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28202024-11-15T21:52:15.817ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28212024-11-15T21:52:15.819ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28222024-11-15T21:52:15.820ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
28232024-11-15T21:52:22.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45264
28242024-11-15T21:52:22.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45264 req_id = b9393806-dedc-4ee5-8c8b-85fd79001de2 response_code = 200 uri = /vpc-routes
28252024-11-15T21:52:23.059ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
28262024-11-15T21:52:23.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45264 req_id = fcc76807-7c64-4ec5-8e18-125ce1c86595 response_code = 204 uri = /eip-gateways
28272024-11-15T21:52:23.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64798
28282024-11-15T21:52:23.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64798 req_id = aa42e0d0-cbd5-40a7-ae10-63de24965ed3 response_code = 200 uri = /vpc-routes
28292024-11-15T21:52:23.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64000
28302024-11-15T21:52:23.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64000 req_id = 8dac6f12-1fdd-429b-af9a-6a2b67370ef2 response_code = 200 uri = /v2p
28312024-11-15T21:52:23.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
28322024-11-15T21:52:23.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64798 req_id = 0449e392-6094-4dfe-a09a-88c4b34a3758 response_code = 204 uri = /eip-gateways
28332024-11-15T21:52:23.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64798 req_id = 89423186-55a5-4ddc-b4c7-0480035b7c9f response_code = 204 uri = /vpc-routes
28342024-11-15T21:52:23.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45264 req_id = 43285b6b-5cfb-443f-98fe-6e703703e7c6 response_code = 204 uri = /vpc-routes
28352024-11-15T21:52:23.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54321
28362024-11-15T21:52:23.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54321 req_id = 82ca7b5d-612a-498a-a7f4-d181051a06ea response_code = 200 uri = /vpc-routes
28372024-11-15T21:52:23.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58607
28382024-11-15T21:52:23.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58607 req_id = b746a27b-3089-4aac-87ce-547413ed88f9 response_code = 200 uri = /v2p
28392024-11-15T21:52:23.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41314
28402024-11-15T21:52:23.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28412024-11-15T21:52:23.370ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28422024-11-15T21:52:23.370ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:177
28432024-11-15T21:52:23.370ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:177
28442024-11-15T21:52:23.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54736
28452024-11-15T21:52:23.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54736 req_id = 86f5b93b-62f5-4883-ad0b-0692b8c7642b response_code = 200 uri = /v2p
28462024-11-15T21:52:23.387ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28472024-11-15T21:52:23.387ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50
28482024-11-15T21:52:23.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60161
28492024-11-15T21:52:23.395ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
28502024-11-15T21:52:23.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54321 req_id = fde944a7-14cd-49ba-8e10-f573aa802469 response_code = 204 uri = /eip-gateways
28512024-11-15T21:52:23.395ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28522024-11-15T21:52:23.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54321 req_id = 42c98c76-7429-42d7-9c67-e3172cb9b4f5 response_code = 204 uri = /vpc-routes
28532024-11-15T21:52:23.424ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28542024-11-15T21:52:23.424ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9
28552024-11-15T21:52:23.447ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28562024-11-15T21:52:23.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54208
28572024-11-15T21:52:23.455ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28582024-11-15T21:52:23.455ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28592024-11-15T21:52:23.455ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:177
28602024-11-15T21:52:23.456ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:177
28612024-11-15T21:52:23.462ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28622024-11-15T21:52:23.462ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876
28632024-11-15T21:52:23.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57043
28642024-11-15T21:52:23.481ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28652024-11-15T21:52:23.481ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50
28662024-11-15T21:52:23.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55180
28672024-11-15T21:52:23.497ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28682024-11-15T21:52:23.497ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28692024-11-15T21:52:23.497ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28702024-11-15T21:52:23.497ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28712024-11-15T21:52:23.497ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28722024-11-15T21:52:23.497ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28732024-11-15T21:52:23.497ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28742024-11-15T21:52:23.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 586 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55180 req_id = 82842f3f-898c-4cc6-a55f-e6ecbb2fb317 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28752024-11-15T21:52:23.520ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28762024-11-15T21:52:23.520ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9
28772024-11-15T21:52:23.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43164
28782024-11-15T21:52:23.539ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28792024-11-15T21:52:23.539ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8601efa0-7d56-406c-bb55-59ecc862a206
28802024-11-15T21:52:23.544ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28812024-11-15T21:52:23.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149413 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60161 req_id = 0e82eadb-5631-402b-a3e6-d55b57f85d6e response_code = 204 uri = /switch-ports
28822024-11-15T21:52:23.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5994 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60161 req_id = bcfcdc6a-266e-4ab7-bd6a-b02d845e89bd response_code = 200 uri = /network-bootstore-config
28832024-11-15T21:52:23.567ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28842024-11-15T21:52:23.567ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876
28852024-11-15T21:52:23.585ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28862024-11-15T21:52:23.585ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3554a27f-cc97-4d5f-b65f-742b39508465
28872024-11-15T21:52:23.589ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28882024-11-15T21:52:23.614ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28892024-11-15T21:52:23.615ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_85716c71-25b7-416c-85b5-8758a81c43ee
28902024-11-15T21:52:23.630ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28912024-11-15T21:52:23.630ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8601efa0-7d56-406c-bb55-59ecc862a206
28922024-11-15T21:52:23.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62196
28932024-11-15T21:52:23.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43994
28942024-11-15T21:52:23.645ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28952024-11-15T21:52:23.645ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28962024-11-15T21:52:23.645ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 24c905cf-5b99-4656-a4f6-0f32177518a1, kind: Service { id: 5e055384-7079-47b2-95bf-5191a730e1f0 }, name: Name("external-dns-5e055384-7079-47b2-95bf-5191a730e1f0"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a577d32a-aaaf-47e4-8e90-b6afdfdd0394, kind: Service { id: d27385ac-d3f8-425a-9c62-c86cb4a78778 }, name: Name("external-dns-d27385ac-d3f8-425a-9c62-c86cb4a78778"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 478cc145-64fb-4b9c-a5da-a81d4f9f1f34, kind: Service { id: aa8ce9ac-5427-43e3-b71a-a158955330df }, name: Name("nexus-aa8ce9ac-5427-43e3-b71a-a158955330df"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 63])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5c995418-6267-4f62-8b9c-a92a770d9b7e, kind: Service { id: 7537c9dd-3abc-47e4-9cc2-101817dbe35f }, name: Name("nexus-7537c9dd-3abc-47e4-9cc2-101817dbe35f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 59])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed641fc6-6ba3-40ea-8a79-c11d77bab4b9, kind: Service { id: 5a7571a8-c048-48d8-a4d1-00692f1c218e }, name: Name("nexus-5a7571a8-c048-48d8-a4d1-00692f1c218e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28972024-11-15T21:52:23.653ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28982024-11-15T21:52:23.653ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75d1b97e-8e16-4b27-ad0e-659366660685
28992024-11-15T21:52:23.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
29002024-11-15T21:52:23.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29012024-11-15T21:52:23.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29022024-11-15T21:52:23.654ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29032024-11-15T21:52:23.658ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29042024-11-15T21:52:23.659ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29052024-11-15T21:52:23.659ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
29062024-11-15T21:52:23.659ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29072024-11-15T21:52:23.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43994 req_id = 6c227432-d75d-4b38-9d11-a1fbc70b0b92 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29082024-11-15T21:52:23.659ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29092024-11-15T21:52:23.659ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29102024-11-15T21:52:23.659ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29112024-11-15T21:52:23.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62196 req_id = 8c0c7bdf-6a22-497e-bb72-0ea5e4ce0232 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29122024-11-15T21:52:23.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188510 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57043 req_id = b9f2a886-9239-45f1-9e53-7750eb3e29b8 response_code = 204 uri = /switch-ports
29132024-11-15T21:52:23.663ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29142024-11-15T21:52:23.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 670 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57043 req_id = 6aa828eb-0720-43b8-9c10-b786d926ed56 response_code = 200 uri = /network-bootstore-config
29152024-11-15T21:52:23.669ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29162024-11-15T21:52:23.669ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3554a27f-cc97-4d5f-b65f-742b39508465
29172024-11-15T21:52:23.698ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29182024-11-15T21:52:23.698ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_85716c71-25b7-416c-85b5-8758a81c43ee
29192024-11-15T21:52:23.708ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29202024-11-15T21:52:23.713ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29212024-11-15T21:52:23.713ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c
29222024-11-15T21:52:23.731ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29232024-11-15T21:52:23.731ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75d1b97e-8e16-4b27-ad0e-659366660685
29242024-11-15T21:52:23.746ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29252024-11-15T21:52:23.746ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_07f78be9-2bf1-4fec-908e-2af18da98913
29262024-11-15T21:52:23.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 397492 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41314 req_id = cf2a41d8-e74a-417a-8522-619d67388fda response_code = 200 uri = /inventory
29272024-11-15T21:52:23.771ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29282024-11-15T21:52:23.771ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c
29292024-11-15T21:52:23.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43164 req_id = f97e95ea-d54c-4fe6-922f-29403da4553c response_code = 204 uri = /switch-ports
29302024-11-15T21:52:23.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43164 req_id = 2b946de9-018b-4a54-9801-b0e8c377bbe4 response_code = 200 uri = /network-bootstore-config
29312024-11-15T21:52:23.796ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29322024-11-15T21:52:23.796ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_07f78be9-2bf1-4fec-908e-2af18da98913
29332024-11-15T21:52:23.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 353023 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54208 req_id = 7fe29984-2b6f-4e6d-840d-cb113c45ce58 response_code = 200 uri = /inventory
29342024-11-15T21:52:24.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41212
29352024-11-15T21:52:24.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29362024-11-15T21:52:24.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29372024-11-15T21:52:24.756ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/config/omicron-zones.json file = common/src/ledger.rs:177
29382024-11-15T21:52:24.756ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/config/omicron-zones.json file = common/src/ledger.rs:177
29392024-11-15T21:52:24.770ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d615ef58-64cf-40c0-bc96-e752e9c66f50 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29402024-11-15T21:52:24.770ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d615ef58-64cf-40c0-bc96-e752e9c66f50
29412024-11-15T21:52:24.799ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 399573dc-9aa5-448e-8896-7bfbaad8acc9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29422024-11-15T21:52:24.799ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_399573dc-9aa5-448e-8896-7bfbaad8acc9
29432024-11-15T21:52:24.820ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e99022f7-1313-4bbf-8ff5-cd28c0c83876 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29442024-11-15T21:52:24.820ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e99022f7-1313-4bbf-8ff5-cd28c0c83876
29452024-11-15T21:52:24.841ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8601efa0-7d56-406c-bb55-59ecc862a206 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29462024-11-15T21:52:24.841ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8601efa0-7d56-406c-bb55-59ecc862a206
29472024-11-15T21:52:24.862ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3554a27f-cc97-4d5f-b65f-742b39508465 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29482024-11-15T21:52:24.862ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3554a27f-cc97-4d5f-b65f-742b39508465
29492024-11-15T21:52:24.887ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 85716c71-25b7-416c-85b5-8758a81c43ee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29502024-11-15T21:52:24.887ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_85716c71-25b7-416c-85b5-8758a81c43ee
29512024-11-15T21:52:24.909ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 75d1b97e-8e16-4b27-ad0e-659366660685 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29522024-11-15T21:52:24.909ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_75d1b97e-8e16-4b27-ad0e-659366660685
29532024-11-15T21:52:24.931ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd93eebe-c68d-4a35-bc8a-81c378c9224c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29542024-11-15T21:52:24.931ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd93eebe-c68d-4a35-bc8a-81c378c9224c
29552024-11-15T21:52:24.956ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 07f78be9-2bf1-4fec-908e-2af18da98913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29562024-11-15T21:52:24.956ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_07f78be9-2bf1-4fec-908e-2af18da98913
29572024-11-15T21:52:24.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41212 req_id = 6d0b6cb5-fac4-4f96-a0fe-1eee6a009bd7 response_code = 200 uri = /inventory
29582024-11-15T21:52:25.819ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29592024-11-15T21:52:25.820ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29602024-11-15T21:52:25.822ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29612024-11-15T21:52:25.823ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29622024-11-15T21:52:35.642ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43159
29632024-11-15T21:52:35.642ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43159 req_id = 0967ed16-84fe-414c-9b1b-1d30d79a73e9 response_code = 200 uri = /baseboard
29642024-11-15T21:52:35.824ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29652024-11-15T21:52:35.825ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29662024-11-15T21:52:35.827ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29672024-11-15T21:52:35.828ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29682024-11-15T21:52:45.828ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29692024-11-15T21:52:45.829ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29702024-11-15T21:52:45.831ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29712024-11-15T21:52:45.832ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
29722024-11-15T21:52:52.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41954
29732024-11-15T21:52:52.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41954 req_id = 32b9faec-4bc6-4dd7-9ff3-ee5cba5146f2 response_code = 200 uri = /vpc-routes
29742024-11-15T21:52:52.996ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
29752024-11-15T21:52:52.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41954 req_id = ab8d6b43-5fa8-4019-b5e8-c969eeaf4804 response_code = 204 uri = /eip-gateways
29762024-11-15T21:52:53.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41954 req_id = 549a004e-4025-479b-bc85-849dcc1f4662 response_code = 204 uri = /vpc-routes
29772024-11-15T21:52:53.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34071
29782024-11-15T21:52:53.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34071 req_id = e99f649c-ba3a-486e-b5b5-eed56478f69c response_code = 200 uri = /vpc-routes
29792024-11-15T21:52:53.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56016
29802024-11-15T21:52:53.035ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29812024-11-15T21:52:53.094ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29822024-11-15T21:52:53.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143742 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56016 req_id = d2f92239-04ef-4614-b758-38aca7d323e5 response_code = 204 uri = /switch-ports
29832024-11-15T21:52:53.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39156
29842024-11-15T21:52:53.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
29852024-11-15T21:52:53.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34071 req_id = 642d2c50-4f37-484c-98b6-7cdc471f1a2a response_code = 204 uri = /eip-gateways
29862024-11-15T21:52:53.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56016 req_id = 0763f122-862f-45cd-9a94-1fa5e9e3316b response_code = 200 uri = /network-bootstore-config
29872024-11-15T21:52:53.179ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29882024-11-15T21:52:53.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36045
29892024-11-15T21:52:53.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36045 req_id = 94b52bf1-1d21-4f59-9544-5f7966756f86 response_code = 200 uri = /v2p
29902024-11-15T21:52:53.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34071 req_id = 500dd8a1-8c0f-4b8b-82fc-37c11868c201 response_code = 204 uri = /vpc-routes
29912024-11-15T21:52:53.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44920
29922024-11-15T21:52:53.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44920 req_id = 6d8bdb2d-e007-46c4-bedc-ea08fe70842e response_code = 200 uri = /v2p
29932024-11-15T21:52:53.218ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29942024-11-15T21:52:53.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57399
29952024-11-15T21:52:53.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57399 req_id = 36d5c69a-b091-4fbe-b4c5-f01f881e2cc6 response_code = 200 uri = /v2p
29962024-11-15T21:52:53.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60195
29972024-11-15T21:52:53.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60195 req_id = aa634b46-b672-40d7-8a21-e133632404b0 response_code = 200 uri = /vpc-routes
29982024-11-15T21:52:53.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100825 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39156 req_id = e2a9867c-feb6-4232-876e-ce03d0ebea94 response_code = 204 uri = /switch-ports
29992024-11-15T21:52:53.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39156 req_id = 013a2b97-52ff-443e-932f-94a84d0c489d response_code = 200 uri = /network-bootstore-config
30002024-11-15T21:52:53.288ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
30012024-11-15T21:52:53.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60195 req_id = 3f7f3b0c-02d2-4b70-b98a-2319c5295897 response_code = 204 uri = /eip-gateways
30022024-11-15T21:52:53.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60195 req_id = 245fb4b1-8c40-4d99-8f2b-b3050ace452e response_code = 204 uri = /vpc-routes
30032024-11-15T21:52:53.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42931
30042024-11-15T21:52:53.355ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30052024-11-15T21:52:53.392ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30062024-11-15T21:52:53.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84212 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42931 req_id = 97abba92-ab5f-4d42-80aa-611757155c18 response_code = 204 uri = /switch-ports
30072024-11-15T21:52:53.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42931 req_id = 56ed55d3-2607-481d-b296-3da12981660f response_code = 200 uri = /network-bootstore-config
30082024-11-15T21:52:55.832ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30092024-11-15T21:52:55.833ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30102024-11-15T21:52:55.835ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30112024-11-15T21:52:55.836ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30122024-11-15T21:53:05.688ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57789
30132024-11-15T21:53:05.689ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57789 req_id = fbd48fc1-7870-417b-b39f-08c3600f7f68 response_code = 200 uri = /baseboard
30142024-11-15T21:53:05.848ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30152024-11-15T21:53:05.849ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30162024-11-15T21:53:05.851ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30172024-11-15T21:53:05.851ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30182024-11-15T21:53:15.859ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30192024-11-15T21:53:15.859ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30202024-11-15T21:53:15.862ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30212024-11-15T21:53:15.862ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30222024-11-15T21:53:20.638ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
30232024-11-15T21:53:23.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52817
30242024-11-15T21:53:23.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52817 req_id = 6d394078-f3b5-47d2-a8f9-506ae73cd38a response_code = 200 uri = /vpc-routes
30252024-11-15T21:53:23.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40895
30262024-11-15T21:53:23.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40895 req_id = e457bda4-c57a-4ee7-ade9-7523697c3c28 response_code = 200 uri = /vpc-routes
30272024-11-15T21:53:23.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54062
30282024-11-15T21:53:23.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54062 req_id = e928f66c-c0fc-46e8-91b8-f7b8d5bcd225 response_code = 200 uri = /v2p
30292024-11-15T21:53:23.299ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
30302024-11-15T21:53:23.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52817 req_id = 176bc8ab-4671-4c61-8808-b5dedd336d18 response_code = 204 uri = /eip-gateways
30312024-11-15T21:53:23.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52817 req_id = 57df8012-325a-4c66-b591-2454bc70bf50 response_code = 204 uri = /vpc-routes
30322024-11-15T21:53:23.325ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
30332024-11-15T21:53:23.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40895 req_id = 7cd38cf2-aeac-47f0-ad42-f323911ca306 response_code = 204 uri = /eip-gateways
30342024-11-15T21:53:23.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40895 req_id = 2c0fb8ca-5b6f-48fc-ba7a-fcfe0264871e response_code = 204 uri = /vpc-routes
30352024-11-15T21:53:23.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60659
30362024-11-15T21:53:23.371ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30372024-11-15T21:53:23.414ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30382024-11-15T21:53:23.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60659 req_id = 4fdfd9be-6d26-4fca-b216-81414baec476 response_code = 204 uri = /switch-ports
30392024-11-15T21:53:23.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60239
30402024-11-15T21:53:23.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42352
30412024-11-15T21:53:23.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60659 req_id = f453b7e0-a4e1-4fd8-8225-47334fae5815 response_code = 200 uri = /network-bootstore-config
30422024-11-15T21:53:23.479ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30432024-11-15T21:53:23.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6376 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42352 req_id = 57ef5c65-9c33-44df-ab1c-02c853f709db response_code = 200 uri = /v2p
30442024-11-15T21:53:23.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46618
30452024-11-15T21:53:23.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46618 req_id = debbdb00-cbc3-493b-93db-6aff7d467eaf response_code = 200 uri = /v2p
30462024-11-15T21:53:23.519ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30472024-11-15T21:53:23.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51941
30482024-11-15T21:53:23.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51941 req_id = ffd38712-9b1d-4781-976f-53d5a9070be5 response_code = 200 uri = /vpc-routes
30492024-11-15T21:53:23.588ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
30502024-11-15T21:53:23.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51941 req_id = 90b419c0-b528-4e58-89f4-ef3aca4c2521 response_code = 204 uri = /eip-gateways
30512024-11-15T21:53:23.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115962 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60239 req_id = 4b0c99bd-e009-468f-8fef-ab96f711a18e response_code = 204 uri = /switch-ports
30522024-11-15T21:53:23.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60239 req_id = e12532eb-f5dd-45b5-93f1-5740b80365f2 response_code = 200 uri = /network-bootstore-config
30532024-11-15T21:53:23.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51941 req_id = e16b2f2a-2017-48c9-b110-f50389b6d618 response_code = 204 uri = /vpc-routes
30542024-11-15T21:53:23.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38597
30552024-11-15T21:53:23.642ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30562024-11-15T21:53:23.684ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30572024-11-15T21:53:23.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38597 req_id = 50405b3e-94ea-4ed1-b3c0-fc4474be9c42 response_code = 204 uri = /switch-ports
30582024-11-15T21:53:23.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38597 req_id = 840e314b-ea1d-454b-8f49-282807a91f1b response_code = 200 uri = /network-bootstore-config
30592024-11-15T21:53:25.862ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30602024-11-15T21:53:25.862ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30612024-11-15T21:53:25.865ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30622024-11-15T21:53:25.865ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30632024-11-15T21:53:35.715ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64747
30642024-11-15T21:53:35.715ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64747 req_id = 9add9b57-5248-4780-bad5-479af3bbf0d7 response_code = 200 uri = /baseboard
30652024-11-15T21:53:35.850ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30662024-11-15T21:53:35.851ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30672024-11-15T21:53:35.854ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30682024-11-15T21:53:35.855ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30692024-11-15T21:53:45.850ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30702024-11-15T21:53:45.850ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30712024-11-15T21:53:45.853ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30722024-11-15T21:53:45.853ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
30732024-11-15T21:53:52.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55749
30742024-11-15T21:53:52.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55749 req_id = 9e93a2bb-912c-4897-90ee-0730c9dd05d1 response_code = 200 uri = /vpc-routes
30752024-11-15T21:53:53.036ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
30762024-11-15T21:53:53.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55749 req_id = 18ead2b6-5ee2-4b68-a5d2-8073e087fe30 response_code = 204 uri = /eip-gateways
30772024-11-15T21:53:53.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55749 req_id = 929610cf-8c74-42a5-83e1-2ef2e405bfb6 response_code = 204 uri = /vpc-routes
30782024-11-15T21:53:53.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33370
30792024-11-15T21:53:53.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33370 req_id = 7d1850aa-702d-47f1-9035-f0a49a4e8e89 response_code = 200 uri = /vpc-routes
30802024-11-15T21:53:53.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64311
30812024-11-15T21:53:53.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64311 req_id = 5333cd48-3978-4c29-b282-f9c1ae6e0117 response_code = 200 uri = /v2p
30822024-11-15T21:53:53.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
30832024-11-15T21:53:53.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33370 req_id = 64cd4fb5-9ffc-44a9-90b2-d6deed2a0ede response_code = 204 uri = /eip-gateways
30842024-11-15T21:53:53.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33370 req_id = 688698b9-d729-43d7-bf32-b96febf3962e response_code = 204 uri = /vpc-routes
30852024-11-15T21:53:53.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58134
30862024-11-15T21:53:53.126ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30872024-11-15T21:53:53.177ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30882024-11-15T21:53:53.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127803 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58134 req_id = 5f6f756d-ab70-45bc-99f4-2a9f11057c7e response_code = 204 uri = /switch-ports
30892024-11-15T21:53:53.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54968
30902024-11-15T21:53:53.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43149
30912024-11-15T21:53:53.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65148
30922024-11-15T21:53:53.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58134 req_id = c3ea974b-1aea-4c55-9b2b-5ee2336574d3 response_code = 200 uri = /network-bootstore-config
30932024-11-15T21:53:53.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65148 req_id = 7dc9f6bc-782a-4c39-9f35-95ee1794b29f response_code = 200 uri = /vpc-routes
30942024-11-15T21:53:53.254ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30952024-11-15T21:53:53.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54968 req_id = 5f970b47-1487-407a-a56b-a73d6b86eb62 response_code = 200 uri = /v2p
30962024-11-15T21:53:53.297ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
30972024-11-15T21:53:53.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65148 req_id = 35b3abf0-4c03-4201-8c7a-85097da78e3b response_code = 204 uri = /eip-gateways
30982024-11-15T21:53:53.305ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30992024-11-15T21:53:53.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1097 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65148 req_id = ed98f0a9-6f3f-42ae-9287-1fa0cfa02e25 response_code = 204 uri = /vpc-routes
31002024-11-15T21:53:53.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62610
31012024-11-15T21:53:53.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63891
31022024-11-15T21:53:53.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63891 req_id = b5907408-5b0d-4c0f-8c35-801abcba4bbc response_code = 200 uri = /v2p
31032024-11-15T21:53:53.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147897 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43149 req_id = a7c4cc53-fdda-4504-a144-29dae1a9168e response_code = 204 uri = /switch-ports
31042024-11-15T21:53:53.402ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31052024-11-15T21:53:53.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 992 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43149 req_id = c06f5d46-fe3e-4a23-bfbe-4fa8f2d47987 response_code = 200 uri = /network-bootstore-config
31062024-11-15T21:53:53.461ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31072024-11-15T21:53:53.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227954 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62610 req_id = 9d3db7dc-cf29-4d32-b56f-d2490616e8ac response_code = 204 uri = /switch-ports
31082024-11-15T21:53:53.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62610 req_id = 652a8dd3-841b-45dd-9c74-1ba456a53935 response_code = 200 uri = /network-bootstore-config
31092024-11-15T21:53:55.854ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31102024-11-15T21:53:55.855ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31112024-11-15T21:53:55.857ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31122024-11-15T21:53:55.858ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31132024-11-15T21:54:02.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49441
31142024-11-15T21:54:02.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49441 req_id = dc2fd492-069f-41a6-afb5-06836aa9e7b2 response_code = 200 uri = /v2p
31152024-11-15T21:54:02.197ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(12858275) }
31162024-11-15T21:54:02.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 724 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49441 req_id = d5481b83-9999-463f-9eb9-4f1391cd324c response_code = 204 uri = /v2p
31172024-11-15T21:54:02.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56868
31182024-11-15T21:54:02.322ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e2658746-a411-4a4e-9169-a12ad4a396bb, kind: Instance { id: db5a96e5-953b-4a42-9728-0596f28327ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12858275), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2658746-a411-4a4e-9169-a12ad4a396bb, kind: Instance { id: db5a96e5-953b-4a42-9728-0596f28327ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12858275), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2658746-a411-4a4e-9169-a12ad4a396bb, kind: Instance { id: db5a96e5-953b-4a42-9728-0596f28327ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12858275), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(12858275))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2658746-a411-4a4e-9169-a12ad4a396bb, kind: Instance { id: db5a96e5-953b-4a42-9728-0596f28327ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12858275), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-94577ea7a94", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 5c74db45-0feb-49aa-9c82-4f4d89d5bb32, read_only_parent: Some(Volume { block_size: 512, id: 46962abf-b7fc-401c-9354-8f7dcef4a51b, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1a4a5de6-2852-4717-a3cb-ca7eb96ba0eb, key: Some("97lIXHS9r6i1Mp+m4OulqSkuk/hfGdCcntRXG9yot44="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5c74db45-0feb-49aa-9c82-4f4d89d5bb32, key: Some("7z/3K6VUKHB0wgqFKYtpIU4Ijee5kV3YT5cVY/7R9uY="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::13]:19000", "[fd00:1122:3344:101::14]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-94577ea7a94" }] }), cloud_init_bytes: Some(..) } instance_id = db5a96e5-953b-4a42-9728-0596f28327ba metadata = InstanceMetadata { silo_id: dba2ea2d-2632-4f3f-a3b4-c59c04735431, project_id: 607fdceb-9960-4ed0-9f9f-546578dad0a1 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-15T21:54:02.310936312Z }
31192024-11-15T21:54:02.322ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba migration_id = None propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31202024-11-15T21:54:02.322ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba migration_id = None propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e2658746-a411-4a4e-9169-a12ad4a396bb, kind: Instance { id: db5a96e5-953b-4a42-9728-0596f28327ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12858275), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2658746-a411-4a4e-9169-a12ad4a396bb, kind: Instance { id: db5a96e5-953b-4a42-9728-0596f28327ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12858275), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2658746-a411-4a4e-9169-a12ad4a396bb, kind: Instance { id: db5a96e5-953b-4a42-9728-0596f28327ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12858275), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(12858275))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e2658746-a411-4a4e-9169-a12ad4a396bb, kind: Instance { id: db5a96e5-953b-4a42-9728-0596f28327ba }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(12858275), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-94577ea7a94", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 5c74db45-0feb-49aa-9c82-4f4d89d5bb32, read_only_parent: Some(Volume { block_size: 512, id: 46962abf-b7fc-401c-9354-8f7dcef4a51b, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1a4a5de6-2852-4717-a3cb-ca7eb96ba0eb, key: Some("97lIXHS9r6i1Mp+m4OulqSkuk/hfGdCcntRXG9yot44="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5c74db45-0feb-49aa-9c82-4f4d89d5bb32, key: Some("7z/3K6VUKHB0wgqFKYtpIU4Ijee5kV3YT5cVY/7R9uY="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::13]:19000", "[fd00:1122:3344:101::14]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-94577ea7a94" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-15T21:54:02.310936312Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
31212024-11-15T21:54:02.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12603 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56868 req_id = 6dab392e-b31b-4dd2-9def-91648ccb63ad response_code = 200 uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8
31222024-11-15T21:54:02.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61823
31232024-11-15T21:54:02.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 498 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61823 req_id = 1042a45c-8a01-4592-bfca-23d5edab1460 response_code = 200 uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8/state
31242024-11-15T21:54:02.403ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 12858275 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
31252024-11-15T21:54:02.403ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31262024-11-15T21:54:02.453ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8 file = illumos-utils/src/zone.rs:325 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31272024-11-15T21:54:02.477ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8 file = illumos-utils/src/zone.rs:363 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31282024-11-15T21:54:02.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52784
31292024-11-15T21:54:02.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52784 req_id = b1bead81-018c-48e2-b5b3-10f41373ff09 response_code = 200 uri = /vpc-routes
31302024-11-15T21:54:02.557ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {e2658746-a411-4a4e-9169-a12ad4a396bb: {10.151.2.176: {40b40265-854c-4460-b148-1da8e57db3ba}, 10.151.2.175: {40b40265-854c-4460-b148-1da8e57db3ba}}} }
31312024-11-15T21:54:03.883ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31322024-11-15T21:54:03.883ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8 zone file = illumos-utils/src/running_zone.rs:488 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 zone = oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8
31332024-11-15T21:54:04.060ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8") failed: Property not found. retry in 34.596647ms file = illumos-utils/src/svc.rs:36 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 zone = oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8
31342024-11-15T21:54:04.106ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8") failed: Property not found. retry in 50.748559ms file = illumos-utils/src/svc.rs:36 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 zone = oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8
31352024-11-15T21:54:04.180ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8") failed: Property not found. retry in 222.07782ms file = illumos-utils/src/svc.rs:36 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 zone = oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8
31362024-11-15T21:54:04.420ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8") failed: Property not found. retry in 276.783159ms file = illumos-utils/src/svc.rs:36 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 zone = oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8
31372024-11-15T21:54:04.709ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8") failed: Property not found. retry in 575.770334ms file = illumos-utils/src/svc.rs:36 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 zone = oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8
31382024-11-15T21:54:05.304ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8") failed: Property not found. retry in 1.096547677s file = illumos-utils/src/svc.rs:36 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 zone = oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8
31392024-11-15T21:54:05.745ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63923
31402024-11-15T21:54:05.745ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63923 req_id = cde36867-46cd-4888-ab7a-1d01422e96ea response_code = 200 uri = /baseboard
31412024-11-15T21:54:05.858ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31422024-11-15T21:54:05.859ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31432024-11-15T21:54:05.861ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31442024-11-15T21:54:05.862ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31452024-11-15T21:54:06.415ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8") failed: Property not found. retry in 1.236907595s file = illumos-utils/src/svc.rs:36 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 zone = oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8
31462024-11-15T21:54:07.666ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8") failed: Property not found. retry in 873.66295ms file = illumos-utils/src/svc.rs:36 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 zone = oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8
31472024-11-15T21:54:08.553ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8") failed: Property not found. retry in 1.312663066s file = illumos-utils/src/svc.rs:36 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 zone = oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8
31482024-11-15T21:54:09.900ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8 file = sled-agent/src/instance.rs:1787 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31492024-11-15T21:54:09.910ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31502024-11-15T21:54:09.946ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31512024-11-15T21:54:10.084ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31522024-11-15T21:54:10.085ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31532024-11-15T21:54:10.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7528728 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52784 req_id = 2c0e2dad-e71f-45c5-9c62-5c5361515529 response_code = 204 uri = /eip-gateways
31542024-11-15T21:54:10.087ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-15T21:54:10.087016912Z } file = sled-agent/src/instance.rs:780 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31552024-11-15T21:54:10.087ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-15T21:54:10.087016912Z } propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31562024-11-15T21:54:10.087ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-15T21:54:10.087016912Z }, migration_in: None, migration_out: None }
31572024-11-15T21:54:10.100ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-15T21:54:10.100852622Z } file = sled-agent/src/instance.rs:780 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31582024-11-15T21:54:10.100ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-15T21:54:10.100852622Z } propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31592024-11-15T21:54:10.100ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-15T21:54:10.100852622Z }, migration_in: None, migration_out: None }
31602024-11-15T21:54:10.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52784 req_id = 37cfbf5c-f1bf-490f-b110-0c0d45f3a605 response_code = 204 uri = /vpc-routes
31612024-11-15T21:54:15.860ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31622024-11-15T21:54:15.861ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31632024-11-15T21:54:15.863ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31642024-11-15T21:54:15.864ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31652024-11-15T21:54:20.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33018
31662024-11-15T21:54:20.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 556 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33018 req_id = ef693685-0927-4471-8efc-77da7fda0307 response_code = 200 uri = /vmms/36f20a22-3f40-4064-a8be-fea89629f5a8/state
31672024-11-15T21:54:20.011ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-15T21:54:20.011514243Z } file = sled-agent/src/instance.rs:780 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31682024-11-15T21:54:20.011ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-15T21:54:20.011514243Z } propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31692024-11-15T21:54:20.011ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-15T21:54:20.011514243Z }, migration_in: None, migration_out: None }
31702024-11-15T21:54:20.107ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-15T21:54:20.107128844Z } file = sled-agent/src/instance.rs:780 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31712024-11-15T21:54:20.107ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-15T21:54:20.107128844Z } propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31722024-11-15T21:54:20.107ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31732024-11-15T21:54:20.107ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31742024-11-15T21:54:20.107ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 13199900981147789718 n_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31752024-11-15T21:54:20.107ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 6043202338545778082 n_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
31762024-11-15T21:54:20.107ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31772024-11-15T21:54:20.107ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/032a36b9-170e-41b5-a8b4-ceca9af83895/debug/bundle/zone", "/pool/int/d51009ae-3f60-480d-999c-9e7ec880cfcb/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/d615ef58-64cf-40c0-bc96-e752e9c66f50/crypt/debug", "/pool/ext/399573dc-9aa5-448e-8896-7bfbaad8acc9/crypt/debug", "/pool/ext/e99022f7-1313-4bbf-8ff5-cd28c0c83876/crypt/debug", "/pool/ext/8601efa0-7d56-406c-bb55-59ecc862a206/crypt/debug", "/pool/ext/3554a27f-cc97-4d5f-b65f-742b39508465/crypt/debug", "/pool/ext/85716c71-25b7-416c-85b5-8758a81c43ee/crypt/debug", "/pool/ext/75d1b97e-8e16-4b27-ad0e-659366660685/crypt/debug", "/pool/ext/bd93eebe-c68d-4a35-bc8a-81c378c9224c/crypt/debug", "/pool/ext/07f78be9-2bf1-4fec-908e-2af18da98913/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8
31782024-11-15T21:54:20.784ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8", bundle_id: 85073154-b4c1-4c1a-964e-03fd8d6fece1 }, time_created: 2024-11-15T21:54:20.108159350Z, version: 0, cause: TerminatedInstance }
31792024-11-15T21:54:20.784ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_36f20a22-3f40-4064-a8be-fea89629f5a8 file = sled-agent/src/instance.rs:1032 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31802024-11-15T21:54:22.559ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31812024-11-15T21:54:22.577ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(12858275), kind: System }
31822024-11-15T21:54:22.577ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(12858275), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
31832024-11-15T21:54:22.579ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-15T21:54:22.579366209Z }, migration_in: None, migration_out: None }
31842024-11-15T21:54:22.615ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-15T21:54:22.579366209Z }, migration_in: None, migration_out: None }
31852024-11-15T21:54:22.618ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = db5a96e5-953b-4a42-9728-0596f28327ba propolis_id = 36f20a22-3f40-4064-a8be-fea89629f5a8
31862024-11-15T21:54:23.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38252
31872024-11-15T21:54:23.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38252 req_id = d3d2d679-17e3-42ec-8bf3-8f13444595ea response_code = 200 uri = /vpc-routes
31882024-11-15T21:54:23.131ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {e2658746-a411-4a4e-9169-a12ad4a396bb: {10.151.2.175: {40b40265-854c-4460-b148-1da8e57db3ba}, 10.151.2.176: {40b40265-854c-4460-b148-1da8e57db3ba}}} }
31892024-11-15T21:54:23.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38252 req_id = 8d9e683c-2628-4023-be83-d57a459a3396 response_code = 204 uri = /eip-gateways
31902024-11-15T21:54:23.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52927
31912024-11-15T21:54:23.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52927 req_id = a547aee9-e04b-4b1c-a5aa-5de86939618e response_code = 200 uri = /v2p
31922024-11-15T21:54:23.170ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(12858275) }
31932024-11-15T21:54:23.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52927 req_id = ee4f6b84-b976-410c-9ddb-60c477a4407a response_code = 204 uri = /v2p
31942024-11-15T21:54:23.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38252 req_id = 48dfefbf-e8a6-40d5-beac-21dcbafdda38 response_code = 204 uri = /vpc-routes
31952024-11-15T21:54:23.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35032
31962024-11-15T21:54:23.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35032 req_id = 613dc6dd-f1dc-4849-a610-2e5810b2245b response_code = 200 uri = /vpc-routes
31972024-11-15T21:54:23.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58190
31982024-11-15T21:54:23.249ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31992024-11-15T21:54:23.292ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32002024-11-15T21:54:23.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135277 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58190 req_id = ea92e865-1761-48ae-8572-ac3d85df150a response_code = 204 uri = /switch-ports
32012024-11-15T21:54:23.385ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {e2658746-a411-4a4e-9169-a12ad4a396bb: {10.151.2.175: {40b40265-854c-4460-b148-1da8e57db3ba}, 10.151.2.176: {40b40265-854c-4460-b148-1da8e57db3ba}}} }
32022024-11-15T21:54:23.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35032 req_id = 17c3a6ac-7623-4061-9225-eaed0d1844bb response_code = 204 uri = /eip-gateways
32032024-11-15T21:54:23.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58190 req_id = cc019a6a-eabe-4c51-aff8-0cd8c2a479d2 response_code = 200 uri = /network-bootstore-config
32042024-11-15T21:54:23.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43254
32052024-11-15T21:54:23.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43254 req_id = 89504422-8a11-402c-b8ec-ef74cb3fd50d response_code = 200 uri = /v2p
32062024-11-15T21:54:23.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35032 req_id = 8827ae94-c4b1-4fa7-be89-352330b6281e response_code = 204 uri = /vpc-routes
32072024-11-15T21:54:23.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41693
32082024-11-15T21:54:23.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53286
32092024-11-15T21:54:23.460ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32102024-11-15T21:54:23.504ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32112024-11-15T21:54:23.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106746 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53286 req_id = f9d97f0f-b155-4773-aef8-d38d579e3512 response_code = 204 uri = /switch-ports
32122024-11-15T21:54:23.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40083
32132024-11-15T21:54:23.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41693 req_id = 19e05366-96b8-4514-bab2-fcc5edc163f5 response_code = 200 uri = /vpc-routes
32142024-11-15T21:54:23.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62920
32152024-11-15T21:54:23.567ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32162024-11-15T21:54:23.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53286 req_id = eb32231c-dc92-401e-9149-91eae9987bcd response_code = 200 uri = /network-bootstore-config
32172024-11-15T21:54:23.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40083 req_id = 084feaa3-946d-48dc-a1d4-2d219f7b5694 response_code = 200 uri = /v2p
32182024-11-15T21:54:23.612ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
32192024-11-15T21:54:23.612ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
32202024-11-15T21:54:23.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41693 req_id = ee8ecae2-4b83-47e1-b066-4a07491b2753 response_code = 204 uri = /eip-gateways
32212024-11-15T21:54:23.618ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32222024-11-15T21:54:23.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 850 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41693 req_id = 6f1764b6-2a6d-4f90-bfbf-4c75381df92b response_code = 204 uri = /vpc-routes
32232024-11-15T21:54:23.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121521 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62920 req_id = 645ecb14-23fa-495e-9fb5-09e796917557 response_code = 204 uri = /switch-ports
32242024-11-15T21:54:23.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62920 req_id = f3cc6913-9a01-4406-b696-903fd3146131 response_code = 200 uri = /network-bootstore-config
32252024-11-15T21:54:23.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37531
32262024-11-15T21:54:23.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37531 req_id = 99eb5ac4-007e-47f6-8c6d-d85b03b1f130 response_code = 200 uri = /vpc-routes
32272024-11-15T21:54:23.736ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
32282024-11-15T21:54:23.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37531 req_id = b842ee9b-742e-46b9-a48b-894832842495 response_code = 204 uri = /eip-gateways
32292024-11-15T21:54:23.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37531 req_id = e5879f85-4ab3-4dd9-bd12-f684ae8a0954 response_code = 204 uri = /vpc-routes
32302024-11-15T21:54:23.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45334
32312024-11-15T21:54:23.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45334 req_id = 5501a5fa-b742-478e-a9b6-c8aae600549a response_code = 200 uri = /v2p
32322024-11-15T21:54:23.775ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:878 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(12858275) }
32332024-11-15T21:54:23.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:45334 req_id = 5fcea1d5-3d83-4f41-afca-ad0a2435de35 response_code = 204 uri = /v2p
32342024-11-15T21:54:24.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53985
32352024-11-15T21:54:24.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53985 req_id = 0bd843cb-8758-4269-a3fc-fafb77704419 response_code = 200 uri = /v2p
32362024-11-15T21:54:24.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50666
32372024-11-15T21:54:24.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50666 req_id = 38eb5408-9bd3-4110-874e-62653b062ab8 response_code = 200 uri = /vpc-routes
32382024-11-15T21:54:24.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
32392024-11-15T21:54:24.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50666 req_id = 65afa37b-1559-4ad0-9dc2-6359246ce969 response_code = 204 uri = /eip-gateways
32402024-11-15T21:54:24.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50666 req_id = 686b07dd-02e2-4b03-a44a-505957f2c76e response_code = 204 uri = /vpc-routes
32412024-11-15T21:54:25.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64210
32422024-11-15T21:54:25.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64210 req_id = 312a6a67-3419-46fb-abcd-30d9d6a3df60 response_code = 200 uri = /vpc-routes
32432024-11-15T21:54:25.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 78d47478-5af8-488d-89c5-11be23443b63 values = ExternalIpGatewayMap { mappings: {} }
32442024-11-15T21:54:25.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64210 req_id = 1fd0cc1f-ff00-4541-b7d4-53b2b03c5a65 response_code = 204 uri = /eip-gateways
32452024-11-15T21:54:25.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64210 req_id = 581addf6-6213-48ca-a6c3-42ffe4463098 response_code = 204 uri = /vpc-routes
32462024-11-15T21:54:25.865ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
32472024-11-15T21:54:25.865ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
32482024-11-15T21:54:25.868ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63
32492024-11-15T21:54:25.868ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 78d47478-5af8-488d-89c5-11be23443b63