Not sure what happened....
I change the audio driver from my external ASIO to my internal MME and that worked fine. I later put it back to ASIO to try different setting and it has worked ever since.
Just keep my finger crossed I guess. Thanks for your input. I'll keep those in mind if it happens again.