I have a similar (maybe the same?) problem.

In my case I'm in the process of building a new music workstation, brand new desktop computer running windows 10, brand new interface, Focusrite 2i4. I just started working on it a couple of days ago.

In my case the first time I play any music through the 2i4 after turning on the computer, doesn't matter what the source is, it comes out very distorted and also seems slow????

Unplugging the USB cable from the 2i4 and plugging it back it fixes the problem, and it is then good until the next time I reboot.

So, it is as if the 2i4 is not getting initialized properly on boot time, but gets setup correctly when I reset it by unplugging the cable then plugging it back in?