Of course it would work if it is done right

Idea is not mine at all (I wish) That is how Adobe handled large files for video editing decades ago.
I was thinking not compressing audio files, but diluting them.
For example 20meg Wav file to 1mg 128bit MP3 and so on. So essentially you have two "bins" One for original large files and one for temporary "working" files.