I presume windows 10 pro? If on a laptop you might face too many USB drivers addressing the same controller chip.
You can remove old unused devices with USBdeview. Don't remove the mouse etc though!

Switch off powermanagement in all USB hubs (device manager) and DISABLE windows update with a tool to keep windows from switching it on again.

I bought an expensive 4 controller USB PCIe Sonnet card. Never regretted it: audio interface and external USB drives have their own controller chip, although USB 2.0 is supposed to handle audio OK up to some 30 channels at 96kHz.